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The First-grade Reading Group Study was an experimental effort developed 

♦ 

from the Integration of research and knowledge about how young children func- 
tion in a classroom, especially within the small group format. The most 
important sources of the ideas in the study were the Texas Teacher Effective- 
ness Study (Brpphy and Evertson, 1976; Note 1) ♦ program development work 
done at the Southwest Educational Development Laboratory (1973) and tj^e 
work of Marion Blank (1973). 

The result of the integration of these sources was an instructlonax 
model consisting of 22 specific principles believed to promote effective 
teaching of young children in small groups. This model is presented as it 
applies to first-grade reading groups in Brophy, Anderson, Greenhalgh, 
bdgen, and Sellg (Note 2) , and in Appendix A. 

Although the Ideas present In the instructional model arc based on pre- 
vious research and experience suggesting their effectiveness in producing 
student learning, the pur^jose of the study was to test the model experimen- 
tally to confirm this. Such experimental efforts are necessary if the find- 
ings of correlational studies arc to be validated and relacionships bietween 
variables* explained. 

The past several years have seen* mr.ny process-product studies o*" teaching 
effectiveness, in which observed teacher behaviors are related to stu »ent 
outcomes, roost usually achlevemenc. For general reviews of work in this tra- 
dition, see Rosenshine, (1976) . Borich (1977), and Medley (Note 3). 

These process-produr.t studies have been correlational in nature, so that 
it has not boen possible to say that a set of teachl;ig behaviors directly led 
to studt'iU otit<u>mo.s. Ro^sonshino ami Furst (197 ^) described throo important 
stapes in tho dc'sign of research on teaching: descriptive, correlational, and 



experimental, and they eiiphasised th c the last step mu&t le taken bef^ 
relationehips between classroom process variables can be accepted as valid* 

% 

% 

be<^au8e only experimental results will allow conclusions about causality. 
Dunkln and Biddle (197A) echoed this by noting, after an exhaustive survey 
of existing re.<tearch on the effects of clasfrroora processes, that "process- 
process and proco88'*product experiments concerning teaching should be 
encouraged, but preferably for the validating of crucial relationships 
previously discovered in field surveys or with strong theoretical justi- . 
fication" (p. 466). • ' 

It was from this perspective, therefore, that the first-grade Reading 
Group Study was conceived and carried out^ There exidled a body of infor^ 
toation i\bout teactkng practices in a pai^ticular setting (small group 
instruction in early elementary grades) • These were integrated into an 
instructional model consisting of ?2%specific principles describing teaching 
techniques which served as the ^•treatment" in an experimental study ♦ Exten- 
*sive observational data Here collected in 20 first'^grade classrooms to allow 
the invest legators to examine the effects of the tV^atment on both student* 
achievement and teacher behaviors » and to examine process-product relation- 
ships ^ including some directly relevant to the treatment and others inde- 
pendent of ii. 

This rep%^rt presents and discusses data that address the major ques- 
tions of the study at the classjroom level of analysis • Because the report 
contains much detail and addresses many questions, the reader is advised 
to review the outline givoh below *md consider the suggestions before 
beninnlnp, to rc«id. 



♦ Organtzation of the report s The report la divided Into six chapters ♦ 
With the exception of CJiapters 2 and 6, the text Is organized atovStd Categories 
^ that correspond to parts of tho Instructional moJel and other observational 
variables « 

« Chapter 1 presents the background and methodology of the study » and 

^ discusses thi» instructional model* 

Chapter 2 presents data on treatment effects on student uchievoment. 

Cliapter 3 presents data on group differences on process measures In 
order to determine If the treatment teachers* behaviors actually differed 
fr<»u the control teachers'. 

Chapter A presents process-outcome data» In order to determine how 
teaching behaviors were related to student achievement* 

Chapter 5 Is a discussion and contains suggestions for revising the 
instructional model for future use» given the results of this study. 

jChapter 6 contains suggestions for tho design of future experimental 
studies* 

Within Chapters; 3, 4 and 5, detaiUul results are presented and/or 

discussed according to eleven categories of variables, and summaries of 

results for th<*Si' are provided at thr eiul of catli section In Chapters \ 

and A, The cate};ories of variables are: 

1* Getting and maintaining the students' attention (variables 

♦ 

derived from Principles 1 and 2 in the ^struct lona I moid); 

2. Introducing the IcsHon and nt'W tuatorlal to the students 
(Principles 3, 4, 5, and f>); 

3. Ciillln,', on individual studintM in the Rroup (Principles 7, 
8, 9, 10» J : , in.t !:'^; 
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4. Dealing with individual learning rates within the group 
(Principles 13, 14, 15, and 16); * *" • 

5. Responding to answers that Are not correct (Principles 17, 
la, and 19); 

6. Responding to correct answers (Principle 20); 

7. Praise and criticism (Principles 21 and 2f); 

8. Variables describing time usage; 

9» Variables describing curriculum and content covered; 
10 ♦ Variables describing other categories of academic 
teacher-student Interactions (response opportunities) not discussed in 
the instructional iiK>del; 

11» Variables describing behavior contacts. 
The reader who is most interested in general patterns, but not In 
results for specific variables, should read Chapter 1 and the discussions 
(Chapters 5 and 6). and may also want to look at the summary sections in the 
othor chapters. Readers who are only interested in certain variables 
may examine them by moving to the pertinent" sectjlons (as listed a-bove) in 
Chapters 3, 4, and 5. 

Data for all analyses are presented in the tables in Volume II. Most 
of these tables are reduced copies o£ the computer printout, and the order 
of variables in the tables does not reflect the order in which the variables 
are discussed. Therefore, pertinent statistical information is provided in 
the text regarding the strength of significant findings, means, and ranges. 
However, variable numbers are provided so tliat the reader can look up other 
Information provided in Vohime II. 
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Cmpter 1: Background and Methodology 
There were four Impprtant stages in planning and collecting data for 
the Flrst'-grade Reading Group Study. Each Is discussed In this chapter to 

give the reader the necessary hackgrcuiid to understand results presented 

» . ft 

In other chapters. 

1. Development of the Instructional model . The mddel was -the basis of 
the study, and was the result of integration of past research on effective 
teaching of young children. It was described In a short booklet that was 

given to teachers In the treatment* groups. 

» 

2. Selection of teachers and administration of treatment . Twenty-seven 
teachers were Involved in the study, divided into three groups: treatment- 
observed, treatment-^unobserved, and control. Teachers in the two treatment 
groups were given the booklet describing the instructional model, and they 
agreed to implemei^t the model's principles in ,thf>lr Caching. 

3. Classroom observation . Throughout the school year, teachers in the 

treatment-observed and control groups were observed teaching their reading 

« . w 

groups, and data were collected with a cqdlng system which had been designed 

■'■ ^ 

to measure implementation of the instructional model. 

A. Testing of students . At the end of the school year, the students 
in the 27 classrooms were given the reading subtests of the Metropolitan 
Achievement Test, 4.evel I. These students* scores on the Metropolitan Readi- 
ness Test (given at the beginning of the year) Were used as covariates in 
analyzing their achievement. 

Development of the Instructional Model 
Tlio model was presented to the teachers as a set of guidelines for 
teacher management of r'\iiHng ^jroup Instruction. It was "curriculum free" 
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In that it^iid -not focus otl the content or sjiaterlala ^ised in teaching 
reading, but only on teacher behavtora Involved In managing the 9f5up a« 
a whole or managing individual student responses, A major rationale for' 
the model was that every child should receive as much individual atten- 
tion as possible within the group setting, and a major objective of the 
model was to help teachers achieve tlie optimal balance between attention 
to -the group and attention to individuals. ^ 

• 

It was emptasi^ed the teacher *8 role in implementing the model 

was an active and im|fort«nt one. Application of the principles of the 
model involved teacher judgment based on knowledge of individual students* 
needs and the group * sjneeds , The principles were meant to serve as guide- 
lines to be applied as each teacher thought best for each of her groups 
(as it happened, all 27 teachers were female). 

The background and rationale for each principle are discussed below. 
The first 16 principles have to do with organization and management of 
the group as a whole, and the rest* concern teacher responses to individual 
Student answers. They are grouped as they were presented to the teachers. 
In the manual given to the teachers, the presentation of each principle 
(denoted here by underlining) Vas followed by a brief discussion of the 
. rationale and some practical examples (see' Appendix A"* . 




Getting and Maintaining the Studcr4ts* Attention (Principles 1 s 2) 

Principles 1^^*11-2^ emphasized that It is important to catch and main- 
tain the children's attention at the beginning of the lesson. 

1. Tht» teacher fihouHjtse^ a standard and p rodi ctfiblc signal to ^et the 
c hildren *?? a ttont lon. In discussing this principle, it was suggested 

ERIC ' -6- 




to the teachers that they use standard attention-getters In two 
situatfons: when engaged in transitions, from general class activi* 
ties to the reading group » and when getting students* attention at 
the beginning of the group lesson. The rationale for this principle 
was that less time would be wasted in transitions and in "settling 
down" behavior if the students learned to respond "automatically" 
to a familiar signal. This technique was based on research 
suggesting that good management systems minimize wasted time and 
opportunities for disruptive behavior (Kounin, 1970) . % , t 
2. Once JLn the group, the children should be seated witfh their backs 
to the rest of the class while the teacher is facing the class . The 
rationale fpr this principle was that the students in the group 
would be less likely to be distracted by other activities in the 
class when seated* this way, and that the teacher would be better 
able to monitor activities in the rest of the room while teaching 
• the small group. Kounin (1970), discussed the importance of 
classroom m^^torlng as an aspect of "wlthltness" and as a way 
to prevent problems. The teacher who is working with a small 
group remains responsible for the rest of the class,, and therefore 
must , prevent disruption from outsiite the ^roup if the reading 
group lesson is to be taught effectively, and If out-of-group^ 
students are to spend their time productively* 

9 

IntTod ucim tho Les s on and New Material to the St^idents (Principles 3,4,5, 6 6) 

Prlnc^tplcs^ 3^ 4, 5^^ and 6 were c5ncerned with Introducing new material, 
and were based on the premise that an introduction should prepare the 
students for the lesson by getting their attention, teaching new skills 



and tenns before asking the students to apply them» and making sure that * 
the students know what to do In activities . . 

3, The Introdactlon sjl^Id contain an overview of what Is to come In 
order to mentally prepare the students for the>T[>re8entatlon « The . 
rationale for this principle was that students irtio are •tuontally ' 
prepared" for new knowledge or futuxe actlvit.les can better receive 

' and process that Information. That is* an overview should help 

students organize their thinking and focus on the task at hand 
by pointing out relevant aspects. Research support for this 
principle came from Brophy and Ever tson . (Note 1), who found a weak 
but positive relationship between use of advance organl^iers &t the 
beginnings of lessons and studftnt achievement In higher-SES 
classrooms. More ^jeneral support for the principle c^e from 
Ausubel (1963) » who emphasized the importance of advance organizers* 

» 

4, is* also at the beginning of the lesson that new words and sounds 
* should be presented t^ o the children so that they can use them later 

when they are reading or answering questions . The rationale behind 
this principle was that students who know what to expect later In the 

« 

lesson will be able to practice new skills, more easily than they 
yould If they encountered unfamiliar words In the midst ol reading. 
It was assumed that reinforcement ol words within the reading 
lesson Would be greater when the words were presented at the 
beginning, or at least prior to encountering them within §ome 
# context. Therefore, a raVlonale f >r this principle was that break - 
ing up now information into f ntroductory and practice phases wr.ild 

* 

make it easier for the students to It'arn it. 



5, When new words or sounda are preaentedy the teac her should have 
the children repeat them until they can sfty thtem satisfactorily * 
This principle was an extension of Number 4; that is, once new 

information (in this case, new words) has been presented, it is 

« 

important to initially practice using that information in small, 
simple steps so that the students gradually^ increase their skills 
in using it. (Tliis is presumed to be especially important with 
"tool skills" such as beginning reading.) Research support for 
this principle came from Brophy an4 Evertson (Note 1) who fouQ^ 
that practice of new material was positively related to learning 



in high-SES schools. 
• 6. Af eer moving into tfie lesson « but before asking t he children to ^ ^ 
use new material or undertake new tasks, the ^eacher should present 
a demonstration and/or explanation of anv new activity . The 
discussion of th*o principle emphasized that a good demonstration ' 
or explanation included a carefully sequenced presentation of 
^ the processes involved in completing an activity, and was given 
in simple, clear language that children could understand. However, 
it was also emphasized that the teacher is the best judge of how 
much detail and how many steps need be included in an explanation 
for a given group or student. Research support for this principle 
came from Brophy and Evertson (Note 1), who found that, in general, 
lower-SES second- and third-grade students, and therefore presumbly 
lower ability students or those at the beginning of basic skill 
learning, benefited from carefully sequenced instruction, with 
enough redundancy of information to insure that students understand. 
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, . * . . . > 

calling on Individual S^nts in the ^ roup (PrincipJf^ft 7, 6, 9\ 10 f 11, S 12) , 

Principles 7.tHro'ugh 12 dealt, with calling on children. This involved 
dlstrib* :ing individual response opportunities during the lesson, while at the 
same time keeping the entire group alert. 

7. T he teacher should work with one individua l at a time in having the 
Children practl</e the new skill and apply th e new concept > making sure 
that "everyone la checked and receives feedback dur ing the lesson. The 
rationale behind this principle was that, the teacher needed to monitor 

• the progress of. each group member, and that the only way to do this 
was to question each child individually* This implied that excessive 

• * 

use of choral responses would not be desirable. Research support for 
% this principle came from Brophy and Evert son (Note 1) who found that 

second- and third-grade teachers who spent much time with individjal 
students, even within a group context, were more successful than teachers 
who tried to work with the class as a whole or with paits of students. 
This result was interpreted to indicate that students at these grade 
levels need individual monitoring and feedback, especially when learning 
new material and trying to apply it for the first time. A consequence 

* * 

of this principle was that excessive use of choral responses should be 
avoided, since this might mean that some individuals were not genuinely 
practicing a skill, and it would be difficult for the teacher to recog- 
. nize this from choral responses. 

8 . The teach e r sho uld use a pat tern (such as going froy one end of the 
group to the otht-r) for selectin g children to take the ir turns reading 
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in the group or answering quest ibns (as oppo$ed to calling on them 
randomly and unpredictably) . The rationale for this principle was 
"* that students would know when to expect their turn responding, and 
that this would result in both lowered anxiety about being called 
on une3q>ectedly and increased,^teacher control of overeager students 
who tend to call out answers or volunteer more intrusively than 
the quieter students. Research support for this principle came 

♦ 

from Brophy and Evertson (Note 1>, who found that teachers who 

♦ 

did not use systematic procedures for selecting students produced 
lower learning gains. This principle is related to #7, which 
emphasized the nee.d to work with individuals so that all children^ 

♦ 

could practice skills and receive feedback. By use of systematic 

selection, the teacher insures regular contact with each student 

*■ • 

\ * to practice imporfant skills. 

9, In order to keep each member of the group alert and acco untable 
i to all times between turns > the teacher should occasionally 

question's child about a previous response from another child , 
. The rationale behind this principle Vas that the occasional- use 
♦of such comments would prevent any lapses of attention that might 
arise from the use of ordered turns. It was felt that these two 
techniques used together would produce optimal attention, as well 
as the other advantages of ordered turns described above. This 
technique was suggested by work done by Southwert .Educational 
Development Laboratory (1973), where It was included in a series 
of staff development matt-rials for working with kindergarteners 
, in small group settings, and in turn was based on the work of 
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Kounin (1970). 

Calling on volunteere should be prlroarllv restricted to parts of 
the lesson in which. children are contributing personal experiences 
or opinions . The rationale for this principle was that teachers 
who relied too much on volunteers would not be distriljuting response 
opportunities equally, so that shyer students might have less 
contact with the teacher and less skill practice than they needed. 
It was felt that some situations probably were appropriate for 
using volunteers, such as giving personal experiences or opinions, 
so it was left up to the teacher to decide when volunteers should 
be used* However, the principle emphasized that the best way to 

-Achieve the objectives of lessons focusing jon reading skills was 
to use ordered turns and occasionally question a student out of ^ 
turn. Research support for this principle came from the findings 
cited above (#7 and #8) for the use of systematic selection and 
the value of interacting with each individual student as much as 
possible. * . * . • 

' g!}£:r'.i':''^.^lJl"l!LQ'^^"^T t^^^ teacher should retniod the child that 
everyo ne gets a turn and he must watt his turn to. answer .. The 
rationale behind this principle is similar to that of ^10» 

in that letting students call out answers often results in the 
« 

quieter, shyer students petting less interaction with the teacher. 
Research support for this principle comes from Brophy and Evertson 
(Note 1), who found that the frequency of call outs had negative 
relationships with learning fi.iins In high-SES schools, lliere 
were neutral and positive relationships for this benavlor in low- 
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SES schools » suggesting that call outs wight be an Index ot student 
motivation and enthusiasm. Therefore, in discussing the princi'^le, 
it was emphasized that the teacher should not' be overly critical 
of call outs, especially when they might indicate stddent enthusiasm. 
12. The' teacher should avoid rhetorical questions, asked for effect with 

♦ 

no answer expected, or leading questions . Other questioning patterns 
to be avoided are answering one's own questions, and repeating gn astions. ^ 
The rationale behind this principle was that it is important for the 
teacher to communicate to the students that every teacher question 

t 

demands an answer, and that questions can be answered through applica- 
tion of skills. It was felt that teachers who used these questioning 
patterns too much might confuse the students or teacher them to ''second- 
gue^s** ttTe teacher by responding to her tone of voice or sentence 
pattern, rather than listening to the Xiontent of the question. Support, 
for this principle was based on the authors* observations of teachers 
and knowledge of how young children may respond in confx^sing situa- 
tions, and on the writings of Groisser (1964) and Laughlin (1961). 

D ealing with Individual Lccirnin^ R^tos Within the Group (Principles 13,14, 15, S 16) 

Pri nciples 1 3 through - 16 were concerned with meeting Individual learning 
needs within the group setting. These principles suggested techniques such 
as breaking up the group, usinganother child as a model for the group, and 
arranging for tutorial help for students who were not meefing learning 
objectives wirhin the standard group setting and time. 

13. At^some i>£int_ duritig^ tlu>_ }}:&^o?,\Sh!:^S^:\'^]^S'T, "'"^'^ ^ ^ fund amental 

deci s 1 on aboii t >whe the r tlu? r> ro«£ a s_ a wlio Ie_ can or ca nnot meet a 
■ ' lesson*s o bjec tives. The rationale behind this princiole was ttiac 



» 

teachers who remained aware of individual differences in xates of . 
learning of new material would be more likely to prevent problems 
that might arise when one or two students in the group were not 
learning as desired. In such aji^ase, if the group remained together 
and the teacher taught at the lev^l of most of the students; these 
few would be left behind. On the other hand, if she worked with 
one or two students who needed extra help, the other studen:8 would 

• * 

not be spending instructional time efficiently. This principle 
was suggested by woric done at Southwect Educational Development 
Laboratory (1973) . It emphasized that the teacher should make 
sure that everyone in the group has met each lesson objective 
before going on to a new step, but that doing this sometimes would 
mean having to break up the group to fo^s on a few individuals, 
to avoid "losing" them. 

If the teacher decidea that the group as a whole cannot reach the 
objectiL V ell at tWe same ttme» because of large individual differences 
in comprehension of the material, she should teach the more able 
students through to the end of the lesson, dismiss them, and keep 
I n the group thos e few who need extra help*. This principle suggested 
specific techniques for breaking up the group when the teacher felt 
that it was vise to do so. It emphasized that the teacher should 
handle the breaking of the group without fanfare and without 
negative stat foments rej^arding the students who remain for extra 
. help. This principle was also based on the staff development 
m-itcrl alfJ developed at t lie Southwest iMurational Dovolopmcnt » 
Laboratory (1973) . 
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15. Sometimes the teacher may wish to use one or more children who 
have mastered the objectives to serve as models for the others . 
One rationale for this principle was' that sometimes student^ learn 
more quickly or pay more attention to peers whom they respect ^nd 
like. Another rationale was that for some types of learning*, 
especially rote or memory skills, it would be less frustrating' for 

* • 

the teachet and a student to model the sklllt> rather than to 
continue working with students who have not learned them yet because 
they haven *t had enough exposure. This principle was suggested by 
materials produced by the Southwest Laboratory <1973) . They recom- 
mended this especially for skills used in learning a new language, 
or other very basic material that needs to be overlearn^ to become* 
automatic. They suggested that students who were learning new 
language patterns need the opportunity to hear correct parterns 

♦ 

being spoken more than opportunities to practice speaking them, at 
the beginning. It was felt that this was applicable to teaching 
beginning reading, because many of the skills involved there also 
need to be overlearnea to the point of automatic response. 
• I f one or more children s till do not succeed in m^etinR the objectives 
wt thl n_ the time avai lable for the less on^ provision should ht made 
for tutorial assistance . The rationale for this principle was that 
students who failed to meet objectives within a group lesson needed 
to receive extra help instead of being allowed to fall behind. That 
is, the reading group setting could not be efftctlve for them once 
they got behind and had missed important skills that were assumed and 
built on in succeeding lessons^ This principle follows directly from 
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the fact that the beginning reading currlculun Is structured hierar- 

0 

^ chically. It also is compatible with the principles of programmed 

Instruction and of mastery learning (Bloom, 1976). 

Pssponding to Answers That Are Not Correct (Principles 17,18, a 19) 

The second part of the model was concerned with the teacher's role 
in dealing with individual students in the group. These principles focused 

J 

primarily on the feedback given to students about their individual answers. 
Teacher judgment was especially crucial for these principles » because they 
distinguished among types, of <^uestions, types of pacing, and types of student 

4 ♦ 

answers : 

a) A distinction was drawn between two types of questions: those which 
called for short factual answers requiring only memory, and those which could 
be reasoned out. Giving sIGdents hints and encouraging them to reason through 
to an answer Is a possible and sometimes desirable tactic to be used in 
connection with the latter type of question, but not the former. Factual 
questions usually require factual feedback. 

b) It was assumed that different learning objectives would require 
different pacing strategies. Some lesson objectives ai^e taught most effectively 
using fast-paced drill and short answers, while others are taught better in 
slower paced lessons. Extended ie.edback from the teacher takes time, so that 
the pace o/ tKc lesson Is Important to, consider when offering feedbacks 

c) Obviously, the qivality of the student's answer Is very important to 
consider whon deciding on feedback. Infornation given to a child about a 
correct response will differ from that given about an incorrect response. 
The prohlcip facing n teacher wlien a child docs not respond at all Is very 
different from the problem of reacting to a partly incorrect response.- Each 



of these situations requires a different feedback response from the teacher* 
depending upon the demands of the question and the capability of the clviltl* 
In general, the last six principles were based on the premise th^t any 
child's response, whether correct or Incorrect, could be turned into a pleasant 
learning experience by the teacher, using appropriate feedback that considered ♦ 
both informational needs (types of question and types of answer) and the 
lesson's pace. ^ 

♦ 

1 7 - After asking a que stion, the te acher should wait for the child to 
r espond a nd a lso see that othty c hildren wait and do not call ou t 
an>swcrs. Du ring rapi d pacing, she sh ould wait a fe w second s a nd give 
the answe r if there Is no reHponse» During the mo re slowl - ,>aced_ 
parts of the lesson, the tea cher should wait for an an swer as long 
as she feels the j;hija_ls thl_n^^^ " Ot so long 

as to em barrass the chi Id }\t.. }2}^JiLS.h^S^l^^TJ^J^-^}^-t^-^\^ attent ion ♦ 
' If the child d£es_not^ respond with i n slower 

P*"*?5L L*l?*i51lVl»- ^^y*:'. I>?\'i^5.C-.^ll':14Ji. that some response Is 

e xpected b y probing ♦ She sUould Jl.u^^^^ according to Principle 19» 

The rationale for this prlni iplo was tllai students shoulu learn that 
a response is t?xp^< tod of tlmtn, and that the teacher should encourage 
this whenever she can without disrupt inj» the pace of the lesson* 
Research support for this prinr^ple came from Hrophy and Evertson* 
(Note l)^who found that teachers, especially low-SES teachen«, who 
had lower rates of '*no responses** had hlr.her learning ftains* The 
work of Marion Blank (1^>73) also sunnc'Sted this principle* Her gillde-^ 
liiU'S lit UM-hiuK .4t«- *U I I vi d tion; a j»fi».M.jm il i sadv.nita)\ed pre- 



school children and centered on dialogues between a teacher and a 
child, in which the teacher's handling of an incorrect response or 
a lack of response is considered crucial. Generally, the suggestions 
made in this instructional model about feedback to incorrect answers 
correspond to Blank's suggesi:ions . 

18. When the child is incorrect, the teacher should indicate that the 
answer is wrong, and thefl follow simplification procedures outlined 
in Principle 19 « In communicating this principle to the teachers, it 
was emphasized that the incorrect answers should not be met irlth overly 
negative or rejecting reactions by the teacher, but that the student 
should know clearly what was wrong about the answ«5r. The teacher 
should try to be as specific as possible about what was wrong. The 
rationale for this principle was that the student needed informative 
feedback if the incorrect answer was to be used constructively. 
Research support for this principle is discussed below under Principle 19. 

19. Th e appropriate simplification procedure is determined by the type 

of question . * 

^) the qu estion deals with factual knowledge that cannot be re asoned 
out J t he teacher should give the answer to the child and then move on. 

h) If the ques tion Is one that the child cou ld reas on out with help , 
t ho teacher s hould provide cUioa or si mplify the question. If clues 
K t i 1 J._ do_ not help the ch ild, he should .be giv en the answer. The 
t oachor should never ask another c^h lid to sup ply t he answer. 

In explaining this principle to the teachers, it was emphasized 

th.it U was mu<h more imtvirtant Jor the teacher to tay with the child 
who has answered incorrectly, or who has failed to respond, than to 
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go on to another student to get the answer. When the- teacher gave 
the answer to the child, it could be done in several ways. The 
teachers were told that this depende4 on the pace that they were 
trying to maintain in the lesson. If it were rapid* ,the teacher 
should probably give the answer and move on, perhaps occasionally 
having the child repeat the response. If the pace were slower* che 
question could be restated in a £prm that simply called for agree* 
ment, repetition, or choosing between alternatives. When the ' ' 
question was one that the st^ent was expected to figure out '(with 

help if necessary) , the teacher could give clues or rephrase in ways 

7 

that guided the child's thinking in the right direction. If these 
clues did not help, the teacher could then give the answer (rather 
than call on aiK>ther child)* ^ 

• . ,1 
The rationale underlying thl^ principle was that first graders » 

at this point in their learning of basic reading skill*, were more 

likely to listen to and understand* information given during direct 

interactions with the teacher than they were tp learn when hearing 

another student give the answer. Also, there might be unfortunate 

affective consequences if ^teachers regularly gave up and moved on 

to other students when the first student dldn*t answer. A teacher 

who relied instead on the "sustaining" approach embodied in this 

principle feedback was likely to communicate to each student that 

she expected and would be able to elicit some acceptable response 

to each question » and that all 55tudents could learn to listen, 

think and roHpond* 

> 
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Research support for this principle came from the findings 
of Brophy and Evertson (Note 1) for low-SES students In second 
and third grades. For these students, there were positive relation- 
ships with learning for teacher use of sustaining feedhack, hut 
negative relationships for asking other students for answers* This 
hehavibr was not as important for hlgh-SES students, "This was 
interpreted to mean that studWts who are still learning haeic tool 
skills (as first' graders would be, and as the lower-SES second and 
third graders were) benefit more from sustained interaction with 
the teacher than from listening to their peers ♦ Another source of 
support was Blank, (1973) who described several simplification 
techniques useful in certain situations, depending on the charac- 
terlstics of the question, the child's response, and the child's 
personality. A program based on her thinking was successful In 
improving performance on JQ tests of disadvantaged pre-schoolers 
(Blank and Solomon, 1968) . Discussion of this principle In the 
teacher materials also Included suggestions for giving explanations 
when supplying answers to students, rather than giving just the 
answers themselves. 



rt ofipoii ding to Cor roc t Ans w^s (Pri n v iplo 20) 

t he answer . The rationale for this principle was that young students 
do not necessarily knt)w when they are correct, and that they deserve 

♦ 

informative feedback on this point. It is also important for other 
students in the group that tin; correct answer be ackncwledg^cd. It was 
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suggested in this principle that if other students did not hear or 
understand the answer, then the teacher |Bight repeat the answer or 
have the original student rep^i: it. However, it was su^e^ted 
that the teacher not get. in the habit of following eve^ answer with 
repetl^-ion. There was no direct, specific research to support this 

principle » but its rationale stemmed from recognition of the source 

* * 

of young students^ misunderstandings of what is and is not correct 
and from general stress on the importance of feedback « 

■ ■ 

Praise' atKt Criticism (Principles 21 and 22) 

21. Praise should he used in moderation* Th^'^teacjiTer should praise thinking 

and effort more than lust getting the answer^ and should make praise as 

specific and individual as >*possible ^ The rationale here was that praise 

should be used on an occasional basis to reinforce 'the students > but 
« ♦ * • 

if used too on^ch, it would lose its value* It was assumed that 
making praise as specific as possible would convey more information 
to the student about his answer > and would therefore be mdre effective 
feedback* The' research b^se for this principle was a set of sometimes 
contradictory findings* Although there is much agreement that praise 

-4 

can be an .effective motivator^ there has Seen little evidence that 
ther^ is 4 strong relationship between learning or good performance 
and verbal praise. It was hypothesized that one explanation fiar this 
lack of relationship was that most praise was not given very effectively. 
Therofore> it was the purpose of this principle to try to make praise 
more effective and mcaningfifl^ and to examine Its effect, given these 
charac t cris t ics . 
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22. Criticlgft should ^Iso-be as specific as possible, and should incluae ^ 

specification of desirable or correct alternatives . The rationale for 

, this principle was ti»at there is sometimes a reason to give fcriticism 

» because it can be infojmatlve to students and can point out the relative 

aspects of their behavior and/or thinking. However, itf was felt that 

the niore> specific the criticism, the more information is presented 

' ... 

to students, therefore the rationale for^ls prijaclple was very 

^ similar to that for praise. The research base for this principle 

cai^'^pri^arily f rom Brophy and Evertson (Note 1), w^ found that 
the more effective high-SES teachers used some criticism. When 
used by these teachers, Xt was a reflection of high expectations 
/ and demandingness rather than negatlvlstic responses to the student's 

work. In the principle as it was explained to the teachers, it / 
was emphasized that specific, positive instruction should be given 
along with any correction or criticism. ^ 
• In summary, these 22 principles created an instructional model which 
had as its underlying rationale an emphasis on getting and maintaining 
. students' attention, sequencing information clearly for the students, and 
being very careful to provide information about the relevant aspects of a 
question or answer. Although It was not expressed this way in the materials 
given to teachers, the model clearly suggests that the teacher play a 
controlling- and leading role in directing the rea(fing group. In this sense, 
the Instructional, model can be'said to be a .reflection of "direct Instruction" 
(Rosenshinc, 1976), In that It asks the teacher to take on the role of 
•instructional leadership, through constant moAitorlng and control of students' 
behavior and information processing. 
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Ad mtnistratloti' of Traatment to Teachers 

« 

. After developing the instructional model, the next step in the study 
was to give it to teachers in the treatm«it groirps and arrange for a control 
group who did not receive treatment. Nine elementary schools and 27 female 
first-grade teachers were involved in the study, divided among three groups 

as follows: * * 

1. Treatment-observed > Ten teachers in three schools received the 

♦ 

* 

treatment (were instructed in the principles and agreed to us.e them In their 

4 

teaching) and were observed teaching each of their reading groups through- 
out the year. (Student N - 192) 

2. Treatment-unobserved . Seven teachers in three schools received ^the 
treatment but were not observed during the year. This group was included to 

V assess treatment effects in the absence of observation. (Student N « 147) 

3. Control-observed . Ten teachers in three schools were given no 
' ~* • * Si. 

special instructions about how to teach. They were observed throughbut the 

year. This group was Included in order to measure natural Implementation 
of the principles in the absence of a treatment. (Student N - 218) 

The schools were assigned to treatment groups by first creating three 
groups of three schools each which were comparable in SES composition, 
i Although all of the schools were located, in neighborhoods which yofxe predom- 
inantly middle class and Anglo, there was some slight variation among the 
schools in SES ratings assigneihby the district. Therefore, three groups 
were created so as to be balanced In this respect, before being . randomly 
assigned as treatment or control groups. 

The result of this process was that all participating teachers within 
a school were assigned to the same treatment group. This opened the 



possibility of a school effect in . the results* but this was -considered a 
less terious risk than the possible contamination that woi|^d occur if 
teachers within a school were assigned to different groups.- In evaluating 
the overall effect of the treatment on achievement, the possibility of a 
scliool effect was considered. These analyses are discussed later in the 
report. 

All teachers who participated in the study had agreed to do so after 

• * » 

' * # 

di8cu88ing It with the principal investigators* Teachers in the two treat'* 
ment groups were told the purpose of the study (i.e., to experimentally te#t 

4. 

earlier correlational findings) . Teachers in tfiei control grout> wete told 
that the purp^se^of the study was to find out more about effective teaching 
of first-grade reading. 

The 17 teachers in the treatment groups were given a short booklet 
(33 pages) wKich described the instructional model by presenting each principle 
and its rationale (see Appendix A). They were asked to read it and meet 
again a week later with one of the invesCIgdtors* to discuss any questions 
they had. At thld^^econd meeting, the. teachers t >ok a short, multiple- 
choice test overj their knowledge of the principles. All treatment teachers 
demonstrated sufficient knowledRc of the model, and this was the extent of 

« » 

the treatment/ although the* teachers ki»pt the booklets for reference* They 
each agreed to implement the principles in the model as Lhey deemed them 
appropriate for their reading groups* 

CI assroom Ohsoryjij: J on 

Data C ol 1 e <^ t ion 

Tlte troatnioni was applitnl in Ot. tohcr^ 1 and obsorvaLions of teachers 



In fiia treatment-observe^ and <iontrol groups began in Koveniber. Froai 
this time until May, 1975, each of these* 20 classrooms 4fas vlsltf^ 15 to 20 
times (approximately once a week), and observed systematically with a coding 
^stem developed specifically for the study (Brophy, Mahaffey, Greenhalgh, 
Ogden, and Selig, Note A). Three of the teachers (two trieatment-observed 
and one control) left their schools after 2 months of observation for reasons 
unrelated to tlie study. Their replacements agreed to participate in^the 

■ * 

study and were observed the rest of the year. Therefore, scores for these 
teachers are based on about 12 observations. 

The observation system was designed with the 22 principles in mind. 
Therefore, it incorporated measures of implementation of the model, as well 
as other measures to assess the possible effects of such implementation. 
The coding system was organized so that it would follow the natural flow 
of activities during the reading group, but it could be broken down later, 
into specific variables most relevant to discussion of each principle. 

The system was divided into two parts. The first focused on the 
.teacher *s dealing with the groups as a whole, and the second involved her 
academic interactions with individuals. This division reflected^ the theme . 
running throughout the instructional model: the Importance of maintaining 
a balance between management of the group as a whole and interaction with 
individuals within the group. Appendix B contains a summary of the obser- 
vation system, and Appendix C provides a glossary of terms derived from it. 

Group data collected during the observations . The measures in this 
section described the teacher's interactions with the group as a whole. 
These Included activities occurring before the group lesson began, as well 
as certain contacts with the group as a whole that took place during lessons* 



The firsjt thing the observer would note during each observation nas 
Infoxnation' about the teacher's Inanaglng the transition to the group and 
getting the attention of the students once thoy were In the group. Specific 

« 

measures here were addressed to tbo types of attention~getters used and the 
length of time it took to get students to the group and* to get the lesson 
started. (This measured* implementation of Principle 1.) At this point; 

the observer would note how the students and the teacher were seated with 

« 

respect to the rest of the cla^s (Principle 2)* Once the lesson was begun> 

the observer noted the use of an overview and its effects (Principle 3). 

At this pointy the lesson proper would begin ^ and the observer would record 

information about interactions between the teacher and individual students 

(described below). However, during the rest of the lesson, the observer 

would note certain information about the way the teacher dealt with the 

group as a whole , whenever it was available* This included information 

about breaking up the group (as described in Principles 13 and 14) » the 

use of a iJtudcnt modi*! (Principle* IS), the quality of demonstrations 

and explanations (Priaciplu 6), the presentation of new words (Principles 4 

and 5), choral responses and group call outs (Principle 7), and the use of 

undesirable types of questions directed 'to the group as a whole (Principle i; 

« 

I nd i v i dua 1 jia t a S9y}SS^S^.§V^)'}}^t:^}r\^y. ohservat lon s^ When the teacher 
started the Ivs«on» the observer began to describe each ^interaction between 
the teacher and an individual student that started with an academic question 
asked by the.teachi»r (^j'J*p<\^i^ie ppportm^^ Any beha 

occurring during the lesion were also recorded. This coding of individual 
interact i(»n:; continued until the group was ilismisHeil^ although it could 
be interspersed with coding of information about the group* as described 



above* , * . ^ ' 

Each resp onse opportunity was described as to the type of selection, 
the type of question, the type of answer, and the type of feedback. Each 

« 

of these larger categories included several specific types of student or 

♦ 

teacher behavior. For example, under the general heading of "selection," 
the observer would describe each interaction as to the method of selection 
used and whether is was an ordered turn, a volunteer, a call out, etc. 

Behavior contacts were described in terms of the type of student misbe- 

« 

havior (e.g., social, talk, misuse of materials), the type of teacher correc- 
tion, and whether or not the correction was specific as to desired alterna- 
tives. ^ ' " 

The data on response opportunities and behavior contacts were used to 

* 

measure implementation of Principles 7-11 and 17-22. 

All of the coding Of individual students* interactions with the teacher 
was "low-inference" in that the observer was classifying specific behaviors 
into categories according to preestablished definitions. Inference on the 
observer's part was limited, iso that he or she was essentially just counting 

♦ 

specific behaviors when they occurred. Some parts of the group data collec- 
tion were also low-Inference, in that they itjvolved counting or timing, but 
other ^asures were "high-inference". For these, the observer was asked 
to rate extent of use of a behavior or' degree of appropriateness of us use.' 

The observers spent two weeks in the classrooms practicing with the 
system before actually beginning data collection. Pairs observed together 
until the criterion of 80 percent agreement on each major section of the 
coding system was reached. After that time, observers worked alone. Each 

teacher was seen by two observers who alternated visits to her classroom. 

✓ 
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Data Preparation • •» 

At the end of the year, when all observations were completed, many 
scores were computed for each teacher to represent the lmpleBenta.ll:lon and 
effect of each principle In the Instructional model in her classroom. These 
scores represented sums for the entire year, standardized where necessary 
by the amount of time spent in observation. There ^are three types of scores 
reported: rates, proportions* and av^ages. 

Rates were computed by dividing a total frequency in a category by 
either the totat amount of time observed (yielding rate per minute) or the 
number of observations (yielding the average number of occurrences per obser 
vatlon) . ?or the latter computations, an observation was considered to be 
one complete lesson taught to a single group. Therefore, a single teacher 
might be observed teaching from one 'to four groups in a morning, and the 
data for each observation were considered separately for certain scores^ 

Proportion s were relative rates which were computed by comparing the 
number of times that nn event or behavior occurred to the number of times 
that it could have occurred • * Thor^fore, proportion scores range from %00 
to 1.00 • Occasionally, it is easier to discuss a proportion in *:erm8 of 
percentage of time, in which case the corresponding scores are 0% to 100%. 
Example;; of proport tons are **the proportion of observations in which the 
teacher Riivc an overview of specific inKtrucLional content at the beginning 
of the lef;son'* and the ''proportion of all response opportunities which 
included correct answc?rs from the child.*' 

Average*.*? arc u«cd to discusf^ ratings or counts taken on a regular 
basi5;* Th<»fi»> wt^rc hasc*! on the ttunhc»r times the r,cores were reported 
for a particular variable ♦ which ranged from a few observations during 



the year to several Instances in one observation* Examples of s\ich averages 
are "the average number of times p'er observation that the teacher called for 
a choral response" and the "average rating (on a five point scale) of the 
percent of stWents attending to a signal for transition." 

In creating variables from the observation system to be used to evaluate 
the instructional model, several approaches were taken. In many cases, 
single frequencies were expressed both in teims i>f absolute rates per minute 
of time Cor per observation) and also as a proportion of the maxlmxim possible 
score. The resulting list of variables is lengthy but thorough. . 

The variables created from the low-inference data seem complex at first 
sight, due to attempts to make *each one as fine-grained as possible so as 
to detect any contextual effects of types of questions, types. of answers, 
and oral reading vs, questions asked outside of reading turns. The sequence 
used to create these low-inference proportion variables follows. 

First, the proportion of all recorded responses ("R.O.'s") that included 
each separate element was computed, creating variables such as "proportion 
of R.O.*s that were word recognition questions" and "proportion of R.0.*8 
with correct answers," Then, the data were tallied separately for finer- 

« 

grained analyses according to types of questions and/or types of answers, 
resulting in such variables as "proportion of R.O.*s which were word recog- 
nition questions that led to correct answers." (In the tables, this is 
abbreviated for labeling purposes as "proportion of word recognition 
questions that were correct*)' The tables are reduced copies of computer 
printout, so thaf the labels had to fit an 80-character limit.) For some 
variables, a third element was also included, as in, for example, "propor- 
tion of reading questions with incorrect answers which received criticism 



feedback.** ' ^ 

In addition to breaking down the variables according to the ma^or 
division of the low-inference part of the 'observation system (selection* 
question, answer, and feedback), all variables describing response opportu- 
nities were computed 'for total interactions. Interactions occurring during 
reading turns (oral reading) , and Interactions occurring outside of reading 
turns* This was done because oral reading and other questions were coded 
differently due to the different contexts involved. When a childiwas 
reading aloud, the observer coded information only when the child had an 
Interaction with the teacher during the turn. This was almost always due 
to an error in reading. If the child read. completely correctly, the observer 
would note separately that a turn had been completed, but would code no 
other information, because po interactions with the teacher would have 
occurred. However, when a child was asked a single question by the teacher 
(not in a reading turn), the observer always completed a line of coding 
which described the type of selection, question, answer, and feedback. 

Therefore, the coding data for each teachrr contained information 
about the ways she dealt with Interactions during roadlng turns (which 
were almost always errors) and the ways she interacted with students out~ 
side of reading turns when asking them single questions (where the error 
rate varied). There w<»re many commonalities across the two situations, 
but there were also some important contextual differences. Therefore, 
separate low-inference varlal>l«''« were computed for each of these two 
different kinds of interaction, and these two also were combined into 
data for "total" Ittteractions . Tliis h-d to series of variables such as 
"proportinn of total R.0.*8 which contained praise," "proportion of turn 
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response opportunities which contained praise,'* and "proportion of nonturn 
response opportunities i^ich contained praise*" It was hoped that such 
divisions would yield information about what factors rnqst be considered 
in each setting when making decisions about selection, level of difficulty 
of material, types of feedback, and the effects, of such behaviors on overall 
pace. 

Each score was computed for each teacher, representing her average 
behavioF^across all students and all observations. 




At the end of the school year, the observers administered the Metro- 
politan Achievement Test, Level I, to the students in the 27 classrooms. 
Only the reading subtests were given. (Until this time, the observers had 
not Interacted with the students.) The teacher assisted in test admini- 
stration when necessary, so that a ratio of one adult to about 15 students 
taking the test was maintained in all classrooms. However, the directions 
were always given by the observer, according to the test-makers* instruc- 
tions (Durost, Bixler,' Wrightstone, Prescott, and Balow, 1970). The tests 
then were scored according to the manual and standard scores for each 
student were computed from raw scores according to tables provided by the 
test manufacturer. 

The reading subtests were: 

1. Word Knowledge — The students looked at a plctura of a familiar 
object and selected one of four printed words which named dt. 

2. Word Analysis— The students listened to the tesr administrator 
read a word, a sentence containing that word, and the word aj'.ain* and 
then selected the word from a jiroup of four printed for that item number. 




Testing of Students 
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The words in each group of four were always similar in appearance. 

3. Reading — The students read sentences or paragraphs* and then read 
questions about the material » selecting the appropriate answers from three 
or four choices* 

In addition to these three scores, a Total Reading score was computed 
by summing the raw scores for Word Knowledge and Reading. (This was done 
according to Metropolitan scoring instructions.) 

The students who had ,atj>^ded school at the beginning of the year had 
been given the Metropolitan Readiness Test by their teachers. These scores 
were made available to the researchers, and the Total Readiness score was 
used as a co>^ariate in all analyses involving student achievement. The 

« 

Total RocidincBs score was computed from six subtests: 

1. Word Meanliig— The- student selected one of three pictures which 
illustrated a word given aloud by the teachrer. 

2. Listening — Tlie student selected one of three pictures which 
1 llustratt»tl phrasej; or sentences read aloud by the teacher • 

3. Matching— The student marked one of three pictures which matched 
most clos<*ly a given picture. ^ ^ 

A. Alphabet — The student marked one of four lower-case letters which 
wan rviXi] hv iUv ttMthor. 

5. Numbers — The* student.s followed directions read by the teachers 
which te.^tc^d number knowledge » such as marking the box with seven dots. 

6. Copy in};---The student was ^t^ Copy designs* letters, or numbers. 

TJio numual accompanying tht* KeadinesK test gives these correlations 
(N 7^3) brtweeu the Tot.il Ri^adinesii :Kore and the three reading sub- 
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tests of the Achlevenent Test» Level Jt, when given in April of the first 
gra4e <Hildreth» Griffiths* and McGauran, 1969): 
W6rd Knowledge: £ » .68 

Word Analysis: X ■ •66 \ 

Beading: X ** 

In the present sample, class means were conputed to use in analyses 
of other data at the class level. These correlations were found hetween 
the Total Readiness score and each achievement subtest (N » 20). 

Word Knowledge: £ • .75 

Word Analysis: £ •* .71 

Reading's r .58 

Total Reading: jc • .66 
these correlations approximate^ those expected on 'the basis of the test 
manual, with none of the differences even approaching statistical signifi- 
c^ce. Class means were computed for each readiness and achievement sub*' 
test. Table 1 (In Volume II) provides means of readiness «nd achievement 
test scares for each of the three groups of classes. 

Data Analyses 

A variety of analysis procedures were used to examine the data in the 

study. These are summarized below and described in more detail in Chap- 

m 

tors 2, 3» and A. All analyse*; were performed using c t ass roean s , so that 
liie class and/or teacher Is the unit of analyses ^ yielding an N of 20 for 
analyses involving observation data and an N of 27 for analyses Involving 
only achievement data. (Seven treatment teachers were not observed.) 

Three important questions vcre addressed with the data: 1) Did the 
^l^^- !^/J*^, ^,^ Pr . ^A"-'^^*"A 3ShS e yement ? (Reg r«ss ion ana Ivses o f 
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student achievement scores were performed using student readiness and 
treatment ^roup^ membership as predictors. These data are discussed in 
Chapter 2.); 2) Did the 4:reatment have an effect on behaviors? (Analyses 
of variance were performed on the observation data using treatment group 
as^a classifying variable* These data are discussed in Chapter 3.); 
3) What were the relationships between behaviors and student achievement? 
(Regression analyses of student achie^'emen * were performed using variables 
from the observation system and student readiness as predictors. These 
data are discussed in Chapter A.). 
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Chapter 2? Analysis of Achievement Data for Treatatent Effectt 

This chapter examines treatment effects on achievement to detepaine 

if class mean reading achievement was affected' by the teacher's membersliip 

%Xi one of the three groups. 

* Several analyses were performed using different covariates. The^most 

important of these analyses involved looking at cla^s mean achievement as 

a function of class mean readiness' and treatment group membership in order 

to determine if there were differences in achieves^nt between the treatment 

classes and the control classes when entering readiness was taken into 

« 

account « 

Analyses Using Class Mean Readiness as a Covariate 

These analyses were done by a series of linear regression models* 
according to procedures discussed in Ward and Jennings (1972). This approi^ch 
to regression analysis compares pairs of linear models which describe differ- 
ent relationships among the variables. The first of each pair is considered 
the **fu4.1" model, and always accounts for more of the variance in the 
criterion because it contains more predictor terms. The second model is 
considered the "restricted" model. The^formatioa of each model is deter- 
mined by che hypotheses that are being tested. In or^er to determine how 
important Is the difference between two models, their respective error sums 
of squares are computed and compared. These are the squared summed differ- 
ences between the predicted and obtained criterion scores, using the regres- 
sion coefficients obtained for each model to calculate the predicted scores. 
The error sums of squares of the two models are then compared by means of 
an-F-tcst. Significant differences indicate that there is a difference 
in predictive power between the two models, and, therefore, that the full 
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ttodel is a better representation of the data than the restricted laodel. 

The following models were created to describe relationships among 
predictors f or« each of the four achievement test scores : 

1. y- b^G^+ hji^+ h^G^+ b^(R*Gj) + bjCR^G^) + b^(R*G3) + 

2. Y« b^R + bgG^ + b^G^ + b^^G3 + 

3. Y- b^^R + E^ 

A. Y- h^^K + b^3(G^4€2) + ^^4(^3) + 
5. • Y» bj^jR + b^^G2 + bj^7<Gi+G3) + E5 
- 6. Y« b^gR + b^^G^ ^ h9<S"^3> ^ ^6 



where: 

Y** class mean score on one of the four achievement tests. 

hj- regression coefficients for corresponding predictor vectors 

R » cxass mean for the Total Readiness Score 

Gj^*» membership, in group 1 (scored 1 if class was In the * , ♦ 
control Rroup, and 0^ otherwisej 

4 

G2** iiK^mb^rship in group 2, (sconed 1^ if class was in the 
treatment-observed group ^ and ^ otherwise) 

3 • membership in group 3 (scored JL if class *was in the 
treatment-observed group, and 0 otherwise) 

(R*G^)> (R^G^)* .(R*G^)« vectors doWcrlbing the product of the 
class mean readiness score. and group membership for each 
of the groups* (R*G^) would be equal to the readiness score 
if the class was in group 1» and t»ould be 0 otherwise* These 
vectoriJ were used in testing for interaction between readiness 
and group membership. 

(G^+G^) , (G-^+G^)^ and (G^+G^)*^^ vectors containing collapsed 
scores ror group morabership** For (GJ+G2) » ^ class would 
receive a score of 1 if In cither group 1 or 2, and a 0 
otherwise. These vectors were used in testing paired 
comparisons* 



B f error term* (composed of the differences between the actual 
""' Criterion score and that predicted by the equation) 

The following comparisons of models were made for each of ^ the four 
achievement tests: I 



- This comparison tested for an interaction between entering readiness and 



Indicated that tHe^restricted' model without the interaction terms pr^icted 
the criterion as well* as the more complex full model. 

.,2. Model 2 (full) vs. Model 3 (restricted) (Test for treatment effect). 



In the event that Model 2 was shown tq be as sufficient as Model 1 (by the 
first test described)^ Model 2 was then taken as a full kodel and pompared 
to Model 3 which did not include information about treatment group member-, 
ship. If this test was significant, it Indicated that treatment group 
membership was an Important predictor of achievement In addition to entering 
readiness. If not significant/ then the results indicated that the treat- 
ment was not a good predictor of achievement. This is analogous to an 
analysis of covariance. 

3. Model 2 (full) vs. Model A (restricted): Model 2 (fu ll) vs. Model 5 
(restrlQted^ Model 2 (full) vs. Model 6 (restricted) (Tests for group com- 
parisons ). These comparisons were made when Model 2 had been shown to be 
a better predictor \>f achievement than Model 3, which meant that there was 
a "treatment effect.'* These tests are similar to paired coippaifisons which 
would follow an analysis of variance. They were done by creating restricted 
models which did not differentiate between the two groups (Models A. 5, and 
6) and comparing them to Model 2, which did allow different predictive 




treatment group membership. A significant F-ratio indicated that the data 

« 

are better described with the Interactive model (Model 1) • Mo significance 
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weights to'1>6 used for each sepaiuite group. Significance for an^ of these 

tests indicated that the restricted model, vfaich combined two groups » was 

as good a description of the data* as the full model, which did not combine 

those two groups « That is, achievement of the classes in the two groups 

was significantly different, when entering readiness was taken into account: 

Nonslgnificance indicated that there were no differences In achievement^ 

Each of these three types of tests was conducted for each of the four 

achleveiaent tests, using class mean readiness, as a covariate* Statistics 

'2 

for model comparisons are presented in .Tables 2-6, including R valti^s, 
F~ratjU>8, and £~level6, and results are discussed below.* 

Results for testg of interactions between readiness and treatment 
group membership* There were no significant results indicating an inter-> 
action between entering readineas and treatment group membership for any of 
the four tests (see Table 2). 

. Results for tests for effect of treatment group membership* T^ese 
tests revealed significant differences for each of the four tests* There 
were weaker relationships for Word Knowledge and Word Analysis (2. « *06 . 
for each) and more highly significant results for Reading <£ * .02) and 
Total Reading (£ « .05). These results indicate a nonlnteractive treat- 
nent effect on class mean achievement when entering^fTeadiness is taken 
into account (see Table 3) • 

Reeul t a fo r tent s for ey oup compnrlsc^ In order to determine the 
^direction of the group effect » the comparisons were examined. Means and 
standard deviations for each group are presented In Table 1. 

1 • £l!25UL i^J^Ar. ./iL9."il A S^S^PJXP). y^* Trt\itmen t -observed ) ♦ These 
tests revealed weakly significant differences between these two groups for 



the \htd KnoOliedge and Word AnaXysiA subtests (£, « .07 for each) > and note 
highly significant differences for Beading (g. - .01) and Total Reading 
(ji « .05). The means for these two groups showed that the treatment- 
observed group had hljher achievement scores than, the control group. 
According to the test makers' conversion tables > the difference was roughly 
equivalent to one to two month* sgrad^ equivalency (Durost, et al., 1971) 
(see- Table 4). 

2. Group 1 vs. Group 3 (Control vs. Treatment-unobserved) . There ' 
were significant differences found between these two groups for all four 
subtests: Word Knowledge (£ « .03), Word Analysis (£ - .03), Reading 

(£ • .02) , and Total Reading (£ - .02) . Examination of the means showed 
that the treatment-unobserved group had higher achievement scores than the 

contifol group (see Table. 5). 

3. Gr oup 2 vs. Group 3 (Treatment-observed vs. Treatment-unobserved) . 
There were no significant differences between these two groups on any of 
the four subtests. Examination of ^e means indicated that the treatment- 
unobserved group bad slightly higher means on all tests, however. . (aee 
Table 6). 

These data suggest that treatment group membership significantly 
predicted achievement in addition to information about entering readiness. 
The two treatment groups had higher achievement tti&u the control group, 
and there were no significant differences between the two treatment groups. 
The results support the hypothesis that treatment classes would have 
higher achievement. t 
Other Analyses 

In order to see if the results could be attributed to the confounding 
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of treatmefet with schools, other tests were done utilising inforaatlon 
about the schools* 

Models were created of the same general form as the ones given on 
page 36. but which differed in that they described achievement as a function 
of a) treatment group membership atjd school mean readiness; b) group 
membership and both class and school mean readiness; or c) group membershi<f 
and class size. These analyses were performed on Total Reading achievement;, 
scores only. 

Results of analyses using school mean readiness . Regresslpa models 
were the same as those given for the tests involving class means, except 
that all classes within a school received the same school mean score for 
the readiness vector (R) . When the school mean readiness score was used 
as a predictor Instead of class mean readiness, the pattern in the results 
remained the same, although the £-lcvels were not as low (i»e., no signifi- 
cant interaction or differences between the treatment groups, but weak 
or moderate relationships for an overall treatment effect and differences 
between the control and treatment groups). Results are given in Table 7. 

Results of analyses using both school mean and class me an readiness. 
Class mean readiness correlated higher with class mean achievement than 
school mean readiness (.69 vs. .39), and it was decided that class mean 
was a more reasonable covariate. Therefore, in order to test for school 
effect with as much information as possible about entering readiness, 
models were created which contained both school and class mean readiness^ 
as separate covariatcs. The results of this scries of comparisons were 
similar to those using class mean alone, except that the £-levels were 
lower, and there was a significant interaction between treatment group 



membership and cUse mean readiness for the heading and Total Reading 
scores (£ " .03), These data are presented In Table 8, 

In order to examine this unexpected Interaction, the predicted scores 
were plotted for each treatment group using the model that contained both 
class and school mean readiness. The third group (treatmentAmobserved) 
had a relatively restricted range of predicted scores when c<»ipared to 
the other two groups, probably due In part to a lower When .the school 
mean was added into the equation. It had the effect of truncating the 
predicted scores even more than with the class mean scores alone, resulting 
m a near-zero sloj»e for the treatment-unobserved group. This led to 
significantly different slopes for the three groups. When only class 
mean readiness was used to predict achievement, the range of predicted 
scores for the third group was not so truncated, although it was smaller 
than those for the other two groups. The restricted range occurred in 
'the middle. of the ranges found for the other two groups, so that classes 
m the third group did not represent extreme scores. This, plus the fact 
that class mean readiness was more highly correlated with class mean 
achievement, led to the decision to use class mean readiness alone as an 
ability covariate in other analyses. 

R esults of an al yses usIur class size . The last series of tests used 
to analyze the treatment effect compared models which Included class size 
in addition to class readiness. If there were any school effects which 
were not attributable to differences In entering readiness, they might 
be due to size of classes, which did vary somewhat from school to school. 
The Total Reading achievement test scores were analyzed with class size, 
class mean readiness, and treatment group membership as predictors. With 



class size included in the models, there was no significant interaction 
between group menbership and readiness, and the treatment effect remained 
significant (£ « ,02). mt is, class size was not contributing subs tan-. • 

* • 

tially to the prediction of achievement, so that controlling for class 
size did not remoye the treatment effect on achievement. .Results are 
presented in Table 9. 

Summary of analyses of treatment effects on class achievement . The 
classes in the two treatment groups had significantly higher adjusted mean 
reading achievement scores than the classes in the control group, when 
class mean readiness was u^ed as a covariate. There were no differences 
in the adjusted meai^ achievement scores of the two treatment groups, indi- 
cating that observation did not moderate the treatment effect. No inter- 
actions between entering* readiness and the treatment were found. 

Several analyses were performed tp deteraine if the confounding of 
school with treatment was responsible for the treatment effect* School 
mean readiness and class size were each used as a predictor of achievement. 
However* they did not contribute to the prediction of achievement, so 
that a similar pattern of results was obtained as when using class mean * 
readiness and treatment •group as the predictors of achievement. There- 
fore, school effects, at least as measured in these two ways did not 
account for the treatment effect, except insofar as they may be related 
to the average class readiness level. 

These results indicate that the treatment had a beneficial effect. 
However, in order to completely evaluate the treatment, the components 
of it were examined to determine if the treatment teachers were indeed 

♦ 

behaving differently from the control teachers in the ways expected, and 

-'I 
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if those behaviors (He defined by the principles) actually related to 
adjusted student achievement • Other teacher behaviors not directly related 
to the treatment were also compared to see if the treatment-observed group 
differed from the control group in other ways. These questions led to 
analyses of the extensive set of observation variables that are«^ported 
in the next two chapters. Chapter 3 presents" comparisons of the treatment 
and control groups on all observation mel^res » including implementation 
^ of the treatment, while Chapter A reports relationships with, achievement 
for all of the observation variables. 
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Chapter 3t Results of Group Comparisons 
Data on inpldmentatioQ of the iin^ructlonaX model in th« treatment 
and control classrooms are presented in this chapter. To determine whe^rfTer 
the treatment had any effect on teachers' behaviprs, the mean scores for 
the treatment group on each process measure were cwapared to the mean 
scores of the control group ^£n a series of one-way analyses of variance;. 
It was assumed that the scores for the control teachers represented the 
base rates for these behaviors in the population of first-grade teachers 
in the area, and that any signiflcaftt group differences ^n the expected 
directions could be attributed to the t^atment* Variables aeasuring . 
direct^'lmplementation, indirect effects of implementation, and other, 
processes unrelated to the treatment were compared for the two 'groups. 

The' data are presented for groups of related principles in the same 
order that they were discussed in Chapter 1. For each principle, the 
hypotheses are presented the measures used to test them are described, 
and the results are given in terms of the means' of the two groui>8 and the 
level of significance of the mean differences. 

Each variable dj«.^cussed can be examined more closely be referring to 
the tables.. The numbers in parentheses indicate the variable numbers. 
As discussed In Chapter 1, the tables were created directly from computer 
printouts, so that the order of variables In the tables reflects the order 
within the computer program, rather than the order used to discuss them 
in tne text. 

Tables 10 through 12 contain statistics describing these results. The 

tables art' vlividcd according to the type of mcasuro, which may be identified 
by the variable number as follows: a) Table 10 contains variables 
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numbered A026r5379, which describe the ways that the. teacher dealt with 
the groupies a whole (e.g., calling for transitions, asking for choral 
responses); b) Table 11 contains variables nuiabered 1-431, which describe 

# 

rates per minute of components' of interactions between the teacher and an 
individual student (e.g., rate of ordered selection, rate of correct 
toswer); c) Table. 12 contains variables numbered 601^1079, which are 
proportions describing the relative frequency of ty^es of Interactions. 
In addition to providing the variable number, so that readers may 

« 

refer to the tables for more detail, the text also includes some statis- . 
tlcal Information* When the £-level of a comparison is equal to or below 
.10, this is reported* The means for each group are also given for many 
of the variables to indicate the extent of use of each behavior described. ' 
When means are reported, they are usually given in parentheses following 
the discussion of the variable, and always in the same order; t he c ontro l . 
mean first, then the treatment m ean. 

Three levels of significance were considered in intferpretlng the 
results. When .05 < £ < .10. the results are repoifted. but they should 
be recognized as veak relationships. When .01 < £ < .05. results are 
interpreted as representing strong relationships, pecause of the rela- 
tively low N for these analyses (10 for each group), the probability of 
Type II errors is high. Therefore it is Important to consider results 
which fell in the range between .05 and .10 to see if they fit into a 
pattern established by other, moro clearly significant variables. No 
single vartablt* is decisive in interpreting «l.ita of thi« sort. Instead, 
pattcrnr. of results arc moro important. 

s 



Getting and Maintaining the Students* Attention (Principles 1 $ 2) 

Use of an attention getter « Teachers In the treatment group were 
expected to use attention getters more o^ten to hegln transitions and to 
begin leasons and, as a result, to have quicker and easier transitions, 
and to get the students* attention at the beginning » the lesson more 
easily. The use of an attention getter during transitions and at the 
beginning of the lesson was measured by the proportion W all observations 
in which some attention getter was used and by Inforaation about what kind 
was used. There were no treatment effects for the proportion of time that 
attention getters were used in eltlier transitions or at the beginning of 
lessons (5312). Both control and treatment teachers used attention getters 
to signal transitions very often. Mean proportion scores were .80 and .88, 
respectively. However, few teachers in either group used an attention 
getter to start the lesson (5321; means were .05 and .07). 

Although the instructional model did not suggest that any one kind 
of attention getter was best, there were differences between the groups 
in the types of signals used in transitions. The control group was more 
lik ly (p » .06) to use a hell than was the treatment group (5313; .29 and 
.05). On the other hand, treatment teachers were more likely (£ - .07) 
to use a verbal signal (5315; .64 and .89). When an attention getter to 
the entire group was not used, treatment teachers were more likely than 
i'ontrul tecichers to contact individuals directly (5318; • .07; .IS and 
,40). There were no significant differences between the groups for any 
other types of attention getters (5316, 5319). 

V\'v\\ tluMi)-.^ tu' LreatttKMU eff»'<'t was found for the use of .U tent ion- 
>vtting sir.nals. results for variables describing the effectiveness and 
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smoothness of transitions suggested a treatment effect. For example, 
treatment teachers spent a smaller proportion of their total observed time 
In transition to the reading group (A062; £ « .02; means « .13 for control 
and .09 for treatment). 

Transitions were divided Into three components, and each part was 
timed. The first component was the time between the first occurrence of 
some signal and the arrival of the last student in the reading group area. 
This was known as ''transition time to group~«>students.*' The second compo- 
nent was the time from the avrival of the last student in the group to 
the arrival of the teacher, known as "transition time to group — teacher.*' 
The last component of the transition was the time from the teachers* 
arrival to the beginning of the lesson, known as "time to lesson, once 
group is together." T^ere were nVr-dlfferences between the two groups 
in the average amount of time spent in each of these components (4026 > 
4027) , but there was a difference in the proportion of the total transition 
time spent in them^ The treatment teachers had a larger proportion of 
their transition time devoted to getting the students to the group (4059; 
£ « •lO; means « ♦34 and •43) • This means that the treatment teachers^ 
on the average^ spent almost ha]f of their transition time in student 
movement while half was «pent in teacher movement to the group and in 
organizing in preparation for the lesson* The control teachers t on the 
other hand* spent about 60% of their total transition time in teacher 
movement and organization* One possible interpretation of these results 
is that the treatment teachers were devoting less of their allotted time 
to transitions, and wore also better munaftcrs of their own movements 
durinj\ the transit hm, so that proportionately less transition time was 



taken for teacher preparation. This is poaalbly reflective of better over^ 
all preparation, since fewer pjoblens seened to be delaying than. 

In order to judge the effectiveness of the teacher's signals to the 
students, the observers were asked to rate on a five-point scale the percent 

t • , 

of students who attended immediately to the transition signal (5303) or to 
a signal given at the beginning of the l^son (5304) . There were no differ- 
ences between the two treatment gi^ps on these measures (means - 3.34 and 
3.38 for transitions, 3.74 and 3.72 for lessons). 

Another variable measuring the effectiveness of attention getters was 
the frequency of teacher corrections to students about behavior during 
transitions or about lnati;ention before beginning the lesson. There was 
a difference (£ • .06) in the average number of corrections given to Individ- 
uals during transitions (4042). The mean for the control group was 1.29, 
and for the treatment group it was .80. This probably represents fewer 
problems in transitions for the treatment group, although It could indicate 
a reluctance on the part of the treatment teachers to correct students. 

Xhe number of times the teacher had to repeat an attention getter was 
also noted. There were no significant differences in the number of times 
that signals had to be repeated. Both groups averaged one signal per transi 
tlon, and nc'.lther group used a signal very often to start the lesson (4041, 
4043) . 

Seating the grouj). Principle 2 suggested that the teachers seat the 
children In the group so that they were facing th-^teacher and the teacher 
was facing the rest of the class. This was to serve the dual purpose of 
maintaining the attention of students In the pfoup once the lesson began, 
and also of improving the teacher's ability to monitor the classroom. 



Iaplem«ntatloii of this principle was measured with a fly^-point rating . 
scale In vHlch the observer noted the appropriateness of both the teacher's 
seating and the children's seating as the percent oi^>the rest of the class 
which could be seen by each. There were no differences in the average 
rating of appropriateness of teacher seating (5301), %fith the control 
teachers averaging 3.30» and the treittnent teachers averaging. 3.63 (with 
3 representing an unobstrucfred view of.60Z of the class). However, there 
was a difference (£ « .09) in the average rating of child seating (5302). 
The control teachers averaged 2.17 and the treatment teachers averaged 2.72 
(with a rating of 2 Indicating that students in the ^roup could see BOX of 

• * 

* ■ * 

the other students). 

Swmnary of group differences for getting and maintaining the students * 
attention (Princij>les 16 2) , It was expected, that the treatment teachers . 
would be more likely than the control teachers to use signals to get students 
attention at the beginning of transitions and lessons, and that once the 
students were In the groups, treatment teachers would use seating arrange- 
ments to maintain student attention and minimize distraction from the rest 
of the room. The results indicate that these two principles were not imple- 
mented more by the treatment group. 

There were few differences between the treatment and control groups 
regarding their use of signals to start transitions and begin lessons. 
Both groups often used signals for transitions, but neither group used 
signals to start lessons very frequently. There were some differences in 
the types of signals used, but these cannot be attributed directly to the 
m<)del. There were some results indicating that the treatment teachers 
may have had more efficient transitions, although these were not uniformly 




strong. Also, this cannot b« dirsctly reUtsd to ths prineipls» bscsuss 
It emphasised the use of a dear signal to achieve quick transitions and 

* « 

the groups did not differ here. However, it is possible that having their 
attention dr^m to transitions may* have made the treatment teachers wore 
aware of how well they organised ^nd conducted them. 

Results for valuables measuring group seating also did not indicate 
high implementation in either group, although they suggested that the treat- 
ment teachers were slightly atore likely to position their reading group 
students appropriately accprdlng to Principle 2 (i.e., their backs to other 
students in the room). 

Therefore > there was soate evidence of a treatmtat effect for these 
two principles, but it was not very strong. The teachers in both groups 
were already "implementing" both principles^ to some extent, and the treat- 
ment did not increase this 3 -vel of behavior significantly. 

• 

Introducing the Lesson and New Material to the Students {Principle s 3,4,5, S 6) 

Using an overview . Principle 3 suggested that the teacher should 
introduce each lesson with a brief overview. Implementation of this- princi- 
ple was measured hj noting what kind of overview o£J,n8tructional content 
was given during each lesson and when it was given. The observers noted 
whether an overview of the Instructional content was given, an overview 
of the mechanics of the lesson was given ("We are going to read four pages 
today.''), or no overview of any kind was given. They also icted the inclu- 
sion of motivational statements in an overview, and whether these were 
specific or nonspecific. They also rated the enthusiasm of the teacher's 
voice durinf/thc overview, and the apparent effect on students* enthusiasm. 
It was expected that the treatment teachers would be more likely to use 
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overview presenting specific content* 

There was no significant difference betwesn the groups «s to whether 
or not an overview was given (5330)* aj^though there was a. trend (£ « .11) 
in th^ expected direction, with the control teachers, giving no overview 
66t of the time while the treatment teachers failed to give one 51% of the 
time. This suggests that there might have been some treatment effect, 
although the principle was far from being Implemented on a regular basis 

* / 

hf the treatment teachers. 

When an overview was g^an, there was no difference between the two 
groups for inclusion of motivational statements (533A) . There was a differ- 
ence <£ « .06) for the average rating of enthusiasm in the teacher's voice 
(5305), with the control teachers being rated slightly higher on a five*- 
point scale (2.A2 vs. 2*20) ♦ There were no differences in the effect of 
overv.'ews on stud^ents* enthusiasm (5306). 

It must be concluded that Principle 3. was not Implemented on the basis 
of the treatment. 

Presetitinft new words ♦ Principle 4 stated that new yords should be 
presented before the students encountered them in the lesson, so It was 
^pected that treatment teachers would have a higher proportion of^ n«* 
words given at the beginning of the lesson rather than during it. The 
teacher *s presentation of new words was measured b' noting when theiy occurred 
in the lesson, whether they were given at the beginning or the end of the 

% 

lesson^, whether they were^iven by the teacher or asked of a child, and 
what kind of clues were given when the words wete presented. 

Tlie expected difference was not found. Roth groups presented the 
majority of words at the beginning of the lessot (5359; means • .72 for 

('0 
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control and .73 «.or treatment) . For this principle theraforo» there wee 
'*lmplementation*' independent of the treatment (ee. demonetrated by the control 
grottp*8 score), and the treatment did not increase this behavior over the*' 
base rate .of the control group* 

There was a significant effect <£ • .09) for the proportion of new. 
words Which were given by the teacher rather than being asked of a child 
(5360). The control teachers gave the words 42% .of the tine, irtiile treatment 
teachers only did this 20% of the time. This behavior was not specified in 
the treatment, but might be a reflection of other principles which emphasized 
the importance of student responses. \ . 

There was also a significant/difference between the treatment groups 
in the types of clues given whenever new words were presented '(5361«5364) . 
The treatment group was- more likely (£ - .10) to present only phonetic 
clues whenever new words were given to the students (3At and 54%). Again, 
this behavior was not specified by the treatment, so the effect cannot be 
related to it directly. 

There were treatment effects for two of three variables indicating the 
number of presentations of new words. In both cases, the treatment group 

f 

was higher than the control group. The average number of new words presented 
during a lesson (total number of new words over the year divided by the 

« 

number of observation) was different (5358; £ - ,07; means - 1.00 for control 

group, 1.93 for treatment group). The average number of new words which 

t 

were presented at any one time was also higher for the treatment group 
(5369;^2 « .OJ; means - 3.92 for control group, 5.48 for treatment group). 
Th^e were no significant differences in the proportion of lessons In which 
any new words were presented, although the direction of the differences 



was the same (5368; means •» .24 and .34), , . 

Repetition of new words . In order to measure the Implementation of 
Principle 5« repetition of new words, the observer noted for each nev word 

* * 

whether or not it. was repeated by the students and how this was done. Ihere 
were no significant differences in the proportion of new words that were 
repeated by the students, and the trend was not in the expected direction 
C5365; means « .47 and \ 27). There were also no l^ignlf leant differences 
in the proportion of new words that were repeated by all of the students 
rather than by only some of the students (5367; means ^ .75 and .73), 
The first of these measures suggests that there was fairly low implementation 
of this principle for the treatment group and higher , use in the centrol 
group, although this difference was not significant. However, each group 
usually had all of the children repeat when repetition was used. There 
was a significant difference (£ «* .02) in the proportion of niew words that 
were repeated by choral repetition rather than individual repetition (5366; 
means « .83 and .47). It may be that Principle 7, which discouraged choral 
' responses, caused treatment teachers to avoid having students repeat new 
words (choral responses^ may have been the most typical way of getting this 
done efficiently) , 

Demons trat Ions, and e^lanat ions ^ In order to measure implementation 
of Principle 6> teachers^ use of demonstrations and explanations to precede 
student activities, the observer noted whenever a demonstiation occurred, 
rated the sufficiency of that demonstration in his or her opinion, rated 
the students^ apparent comprehension of the demonstration, and noted the 
ways in which the teacher checked fetudent xomprehensione Vflien activities 
were begun without demonstrations, the observer noted whether or not they 
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should have been explained (based on Inferences about student confusion), 
and also whether or not a demonstration was repeated because students did 
not understand. It was expected that the treatment teachers would; have 
more effective demonstrations, and therefore higher ratinga for sufficiency s 
and student comprehension, and fewer repetitions of demonstrations. It was 
also expected that they would have a higher proportion of activities intro- 
duced by teacher demonstration when necessary, and that they would be more 

♦ 

likely to deliberately check for student comprehension before beginning 
activities. 

None of these hypotheses was supported by the data, and there was an 
unexpected result for the last one. There were no significant differences 
for the average rating of sufficiency of demonstration (5310) . On a f ivc 
point scale, the control mean was 2,66 and the treatment mean, was 2.68. 
There was no difference in ratings of student comprehension of daaonstra- 
tlons (5311; -means - 3.74 for control and 3.62 for treatment). There also 
were no differences in the proportion of demonstrations that had to be 
repeated due to student confusion (5351; means » ,02 for control and .04 
for treatment) . 

There also were no differences in the proportion of activities Intro- 
duced by teacher demonstration (5348; means « .93 for control, .91 for 
treatment). The means for this variable Indicate a high level of imple«r 
mentation In the absence of treatment, with no treatment effect above that 
base rate. 

There were five categories for coding teacher checking of students* 
comprehension of the demonstration: asking thera questions, having them 
repeat the Instructions, having them demonstrate the procedure in front 
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ot the group, starting the lesson while in the group end observing u adents* 

ability to complete the activity, and sending students back to their seats 
I 

after the demonstration without checking for comprehension* It was «(pected 
that the treatment teacher's would be less likely to dismiss students with- 
out checking, but this was not the case. In fact, the control teachers 
«^re less likely (5357; £ « .03) to do so, with 27Z of their demonstrations 
ending this way, compared to AOZ for the treatment group. The control 

* 

teachers were more likely <£ *• .01) to keep the students in the group after 
a demonstration and observe them while they did the activity (5356; means • 
.38 and .17) « There were no significant differences in the other three 
ways of checking comprehension} askitig questions (5353; means * .21 for 
control group and .26 tor treatment), having students repeat instructions 
(535A; .02 and .03) an|d having the students 'demonstrate procedures before 
dismissal to do the work (5355; «16 and .19). Therefore, teachers in both 
grdups were doing something to check comprehension most of the time, but 
the treatment teachers were doing this less often than the control teachers. 

Summary of group differences for introducing the lesson and new 
material to the students (Principles 3,4,5, & 6) . The four principles 
in this part of the model were not implemented by the treatment group more 
than the control group. In fact, the few differences that did exist either 
could not be related directly to the instructional model or showed unexpected 
results. It had been expected that the treatment group teachers would give 
overviews more frequently, wpuld present new words at the beginning of the 
lesson more often^ would have students repeat them more often, and would 
give more and better d^cmonst rations^ checking to make sure that students 
unders tood them . 

-56- 



ERIC 



r ■ 

There were no differencee for the wee ot overvlewe, end neither group 
ueed them more than half the time. (There wee a nonsignificant treiid in 
the expected direction, however.) The variables describing the introduction 
of new words did not- reveal any differences that could be attributed direct- 
ly to the treatment. (However, treatment teachers presented more new words, 

and were more likely to use phonetic clues when presenting them) ♦ Most. 

s. 

teachers in both groups presented new words at the beginning of the lesson, 
as suggested in the treatment. There were also no differences in teachers' 
use of demonstrations to precede new tasks, as teachers in both groups did 
this a great deal. The control teachers were more likely to check students* 
comprehension before dismissing them to their seats to do assignments, 
which was not expected. 

Therefore, it must be concluded that the insfructional model did noc • 
influence the treatment teachers to systematically introduce the lesson 
and new material using the methods described In Principles 3 through 6, 

* 

Calling on Individual Students in the Group (P rinciples 7,8,9}20,11. i 12) 

Workin g with one child at a time an d fftvlng feedback. Principle 7 
suggested that the teacher work with one child at a time, offering oppor- 
tunities to practice new skills and receive feedback. An Implication of 
this was that choral responses should be minimized. The Implementation 
of this principle was measured by three types of variables; the rate of 
Individual response opportunities (R.O.*s). the proportion of response 
opportunities which received no feedback from the teacher, and the use of 
choral or group responses. It was expected that the treatment teachers 
would have x hI«hor rate of R.O.'s and lower rates of "no feedback" and 
choral or Rroup responses. 
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Response opportunities were analyzed for total K.O.*s sttmoied over 
reading turns and nontum Interactions, as well as separately for e^ch of 
these situations. (Refer to the discussion of the observation system and 
creation of variables In Chapter 1 for further explana^on of this proce- 
dure.) The rate of total R.0.*8 was different for the two groups (601; 
jg. • .07, control mean • 1.86 Interactions per minute,, treatment mean » 2.20 
per minute) V There was also a significant difference In the number of 
tionturn Interactions per minute (t^02; £ « ,02; control mean • 1.20, treat- 
ment mean »• 1.64). There were no significant differences In the number 
of reading turns per minute offered to the students (603; control mean «* 
.40 and treatment mean • .^6), or In the number of reading turn Interac- , 
tlons per minute '(604; control mean - .65, treatment mean - .56). 

A variable related to this was the proportion of all response oppor- 
tunities which occurred during reading turns. Here, there was a significant 
difference between the two groups (605; £ » .05, means • .36 and .26). 
This suggests that the treatment teachers asked proportionately more single 
questions, so that more interactions occurred outside of oral reading turns* 

There were no differences between the groups in the absolute rate per 
minute of no feedback to K.O. 's (24; means .06 for control and .10 for 
treatment). There were also no differences in the proportion of total 
R.O.*s which received no feedback (723; means • .07 for control and .10* 
for treatment). There was a difference (£ » .10) in the unexpected direc- 
tion for the proportion of nonturn R.0.*8 which received no feedback (724; 
means «= .04 for control and .09 for treatment). These results suggest 
that teachers In both groups pavo feedback to individual students most of 
the time, and therefore were actually implementing this- principle natural- 
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istlcally. However, treatment Mid not prodtice .higher lapleBcntatlon. 

Vheti response opportunities were broken down by type of answer* it 
was evident that neither group of teachers responded to incorrect answers 
very often with no feedback (793, 794; means for total incorrect answers 
were 0 for both groups, and means for nonturn incorrect answers were both 
.01). However, responding to correct answers wltK no feedback was more 
likely for the treatment group than the control group (778: for total 
'correct R.O.'s, £ » .10, with means • .04 for control group and .10 for 
treatment grpup; 779: for nonturn correct R.0.*8, £ • .09, with 
means .05 for control and .11 for treatment). (*'No feedback** was not 
examined separately for turn interaction** because it happened so seldom 
there.) 

There were fairly strong treatment differences in the expected direc- 

/ ♦ 

tlon for the use of group responses rather than Individual responses. 
These were measured by the observer counting the frequency of teachers* 
use of choral responses (the teacher indicated to the students that she 
wanted them to respond together) and the use of group call outs (more than 
one student shouted out the answer to a question together and this response 
was accepted by the teacher, even though she had not indicated that she 
wanted a group response)* These frequencies were analyzed as rates per 
observation and as rates per minute. When considered as the average number 
per observation, there were no significant differences between the groups 
for choral responses alone, although the trend was, In the expected direc- 
tion (A038; means *^ 3.92 for. control and 2.33 for treatment). There were 
dlffercncfs for the average numbor of group call outs (A039; £ • .08; 
neans - 6.10 for control and 3.27 fot treatment) and for the average total 



of choral responses and group call outs (4040; £ • .05; means • 10.02 for 
control and 5. 65 for treatment). When these sane three frequencies were 
examined in terms of rate per miiiute of observation, all three were signi- 
ficant: the rate of choral responses (4051; £ « .10, .17 for control and 
.10 for treatment^, the rate of group call outs (4052; £ » .03, .,27 for 
control, .13 for treatment), and the rate of total choral responses plus 
groups call outs 0^053; £ » .01, .44 for control and .23 for treatment). 
These results indicate that even the treatment teachers were using group 
responses some of the timct but their level of use was much less than that 
of the control group* Therefore ♦ it can be concluded that there was a 
treatment effect for minimizing group responses. 

Types of initial selec t ion of respondents. To measure implementation 
of Principles ^ 10, and 11, observers noted for each R.O. the type of 
selection used to call on the students initially. Initial selection 
meant the way the student was selected for the first interaction within 
a possible sequence of Interactions. Therefore, this was distinguished 
from interactions which were the result of sustaining feedback in the 
immediately preceding^ Interaction. The five typos of initial selection 
were: ordered turns (the teacher chose tiu student on the basis of seating 
position), •t^'"t'St>lcHjlon (the toaiher n.uned the .student and then asked, the 
question, and was not rMying on seating order to choose the child), non~ 
volunteer (the tearher asked the question, and then tailed on a student 
who had not raised his or her hand and the t»*arher was not relyinj^ on 
sealing* l**r to make the soU»rti<>n), voluntoor (tht .toarher called on a 
Htudent wlu> had raised his or her hand, and vlu) was not seleoltnl because 
of seating order), and ca.U_.*'»?.t (the te.icher asktd a quest iun and some 
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student called out the answer without first receiving permission^ and the 
content of this answer was responded to by the teacher) . It was expected 
that teachers in the treatment group would be more likely to use ordered 
turns, and less likely to use volunteer selections, except for personal 
quest ioKS, and would have lower rates of calling out by students. 

When absolute rates of these selection types were examined, differences 
in the expected direction were evident. There were significant differences 
for three of the rates: ordered turns Cl) JE:.'" •OS, means • .22 for control 
and .56 for treatment), nonvolunteer (3^ £ » ,05, .17 for control and »08 
for treatment), and volunteer (4; £ - .07, ,12 for control and .06 for 
trcatint>n ;) , There were no significant results for the absolute rate of 
preselections (2| means « .08 for control and .05 for treatment) or for 
call outs (.5) means .07 for control and .04 for treatment). 

Another way to examine Implementation of these principles is to look 
at the proportion of response opportunlti<i8 Involving initial selection 
by each of these methods. T'lese were examined separately for total interac- 
tions, selection of reading turns, and nonturn interactions. They were 
;ilH<» broken down at. to type of question: reading questions, in which the 
studt nt woR aske'a to decode words or answer questions about decoding; 
nonreadintj questions, which were related to the reading lesson but whici. 
iHd not involve actUvil decoding skills; and personal questions, which 
required an opinion or personal experience of the stud'^nt* 

Thr first j;ot of variables concerns general response opportunities 
«wlt'"ut l.rtsjkuiK them down by question type). The use of ordered selec- 
ti.. •; stit.ifct to .1 Strom; treatment effect as evidenced by the propor- 
t u.n o\ initial sel,-. lions which were ordered: for total interact i.-.ns 
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(607; £ < .01, means » .2A for control and .72 for treatment), for selection 
of students to begin reading turns (608; £ < .01, means *• «29 for control 
and «82 for treatment), and for selection for nontuni interactions (609; 
£ < ,01, means * .22 for control and .69 for treatment),* It is evident 
from these results that teachers in the treatment group were using ordered 
selection the majority of the time to select respondents, as was suggested 
in the treatment. The control teachers were using it to some extent, but 
not as much as the treatment teachers. 

Preselection was not used very often by either group » but It was used 
significantly more often by the control group as measured by the proportion 
of Initial selections that were preselect Ions « for total Interactions 
(610; j> » .Oil means » .15 for control and ,04 for treatment) » for selection 
for reading turns (611; £ » •01, means « .19 for control aid .05 for treat- 
ment), and for selection for nonturn Interactions (612; '^ •^ ^03, means • 
.12 for control and %04 for treatment). 

There were also strong treatment effects for the use of npnvolunteer 

selection, with the control teachers using this technique significantly 

* 

more than the treatment teachers. Statistics for the proportion of initial 
selections which were nonvolunteer were: for total interactions (613; 
2 < .01 ♦ mrans « .31 for control and .11 for treatment) ♦ for selection for 
rc*^ding turns (^>1A; p < .01, means ^ .34 for control and ^09 for treatment), 
iind for nonturn Interactions (615; £ < .01, means « .29 for control and 
• 1 1 for |t real men t) ♦ 

Likewise, the proportion of Initial $;oleotions which wore voluntoers 
was groatir for the control teachers than for treatment teachers: for 
total interactions (616; .01, means ^ .19 for control and .08 for 




treatment), for selections for reading turns (617 j *0.1., neans ■» *17 
for control and .03 for treatment)* and for nontum tnteractiona C618| 
£ » .03, means « .20 for control and .10 for treatment). 

Significant differences were also present for the proportion of Initial 
selections which were call outs i for total R*0.»s (619; .01, means • 
.11 for control and .05 for treatment), and for selection for nontum inters 
actions (620: £ - ,01, means .17 for control and .06 for treatment). 
Call outs were not used to select students for reading turns often enough 
for separate analysis. 

When initial selections were broken down by type of question, the same 
patterns were evident, although they were not as strong for some types of 
questions. Again, the proportions of interactions selected by ordered 
turns showed highly significant differences* The ^-levels for these compar- 
isons were .01 for all types of questions: total reading questions (621), 
nontum reading questions (622), total personal questions (623), and total 
nonreading questions (624) . In all cases the treatment teachers had higher 
tneans • 

There were also significant dififerences in the proportion of initial 
sclccfcions made by preselections t for total reading questions (625; •» 
.01), for nonturn reading questions (626; £ » .02), and for total nonreading 
questions (627; £ « .06). In all cases, the control teachers used preselec- 
tions more. 

The pattern wa« similar for use of lonvoluntecr sclectionsi. There 
were significant differences for total and nonturu reading questions (628. 
629; X. *»0i for both), for^personal questions (630; £ » .05), and for non- 
rending questions (631; P« .01), with the control teachers using nonvolun- 
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teer selections more for each type of question. 

In the treatment. It was suggested to the teachers that volunteering 
should be minimized overall, especially for academic questions, but that 
it might be used appropriately for personal questions. This suggestioh 
was apparently understood and implemented, because the proportion of ini- 
tial selections which were volunteers shows group differences for total 
and, for nonturn reading questions (632, 633; £< .01 for each), but not 
for personal questions (634; £ *■ .19). There were also no differences in 
the proportion of initial nonreading questions selected by volunteering 
(635) . If it can be assumed that readii|g questions are more likely to 
require students to practice important skills, these results indicate that 
the treatment teachers were being careful to minimize volunteering in this 
more Important situation, but were allowing it under otu r circumstances. 

Call outs also were* examined by type of question. There were no ^ 
differences In the proportion of initial nonturn reading questions selected 
by call outs (637), or the proportion of initial personal questions selected 
by call outs (638) . There were significant differences In the proportion 
of initial nonreading questions (639; £ » *V), and in the proportion of 
initial total reading questions (636; £ «» .0^) , which were selected by 
call outs. To both cases, the control teachers had more call outs. 

Those results Indicate high Implementation by the treatment group of ' 

♦ 

the reroimnondatlons for selection techniques* Ordered selection was used 
only «ibout 30 percent of the time in the absence of treatment > but thts 
was more than doubled in the treatment group* The control group. Instead, 
tended to rely primarily on nonvolunteerlng and volunteering selections 
with some use of preselections and some allowance pf call outs* Tlicrcfore* 

* w 
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they allowed more student control of selection through volunteering end 
call outs, and when controlling selection themselves t typically they did 
not do it In a systematic fashion* 

Principle 11 suggested that teachers discourage call outs» and also • 
made some suggestions for ways of dealing with them when they occurred. 
Implementation of this part of the principle was measured by the observers 
noting when call outs were accepted for academic content, when they were 
also corrected, when they were not accepted but were corrected, and how 
they were corrected. It was expected that the treatment teachers more 
often would correct call outs (remind the student not to call out) and 
refuse to accept their content by responding to the answer Itself. The 
proportion of call outs which were accepted but which were also corrected 
by the teachers was higher in the treatment group than the control group 
(1032; £ - .01, means • .01 for control and ..07 for treatment). However, 
this significant difference does not equate to high Implementation, because 
the treatment teachers did not correct most call outs wheii they did occur, 
as was suggested by the treatment. There was no significant difference 
in the proportion of corrected call outs that were not accepted for their 
content (1001; means • .93 for control and .87 for treatment). These data 
indicate that when the teachers in either group did stop to correct call 
outs, they were not likely to dlso accept the content of that call out. 

Four categories of corrections of call outs were examined: management 
statements (mild corrective statements), warning (moderately severe correc- 
tive statements), c riticism (severe corrective statements), and ignore. 
When all corrected caU outs were considered, there were no differences 
in the ways that control reach-srs and treatment teachers dealt with them 

♦ 
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1037-1039) . When only unaccepted call outa were exanlned for type of 
correction, again there were no group dif ferencea in the waya teachera 

dealt with them (102p« 1023). 

/ 

/ For both unaccepted and accepted call outa» teachers were taoat likely 
to use management atatements to correct the atudenta, rather than more 

« 

severe statements (1037; means • .53 of total call outs corrected with 
management for control and .61 for treatment). One of the suggestions in 
the treatment was that call outs should be corrected fairly mildly (so 
as not to discourage enthusiasm but to teach the children to channel it in 
a different direction) . These data suggest that most teachers were using 
fairly mild corrections most of the time anyway, and the treatment did not 

« 

significantly increase this type of behavior for the treatment group. 

Use of comntents . Principle 9 suggested that the teacher could use 
occasional out-of~turn comments in order to maintain students* attention. 
However, this suggestion was not implemented by the treatment group, and 
there was little or no natural implementation in the control group. The 
means rounded to two places for the absolute rates per minute were .00 for 
both groups, although there was a significant difference at a level of 
2 « .02 (8). The proportion of nonturn response opportunities which were 
conaaents was not significantly different, although this bordered on signif- 
icance (665; £ » .11, means » .00 for both groups). The E ratios and £ 
values for these data suggest that there were group differences, but the 
means were so low that the direction Is not detectable at two decimal 
places, and therefore, the results are meaningless. 

Use of and cs i ra b I e gu cs t i ons . Principle 12 suggested that teachers 
avoid the use of questions which might be confusing to students. In order 

S. 
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to measure implementation of this principle, observers noted the frequency 
of the following categories of "undesirable** questions) rhetorical* answer- , 
ing of one's own question without waiting for students to answer, repeating 
questions, other types of confusing qu>3Stions, and total number of undesir<» 
able questions. These were examined in terns of the average number per 
observation, as well as th,e average rate per minute* Many of these variables 
were not suitable for analysis because of low frequency, and those which * 
were examined yielded no significant results * (4045*4049, 4055, 4058)* 
Undesirable types of questions did not occur often (the aver'*ge total per 
observation was only .70 for the control group and ,56 for the treatment 
group). Therefore, there was natural implementation of this principle, 
even in the control group, because the problem did not occur very often, 
and no effect on the treatment, group beyond the base rates was present. 

-s 

Summary of results for principles relating to calling on individual 
students in the group (Principles 7,6^9,10*11* 6 W • This set of principles 
made suggestions about giving response' opportunities to individual students 
In the group, providing feedback to response opportunities, and selecting 
students for R.O.*j, along with general guidelines for types of questions 
to avoid. It was expected that treatment teachers would' have: a lower 
rate of group responses; a higher rate of individual responses; a lower 
rate of "no ^'eedbacV*' from the teachei ; a higher' rate of ordered selec- 
tion and a correspondingly lower rate of volunteer selections and call 
outs, at least for academic questions; a higher rate of use of comments 
by other students; and a lower rate of use of undesirable questions. 

Many of these expect itlons were supported. Treatment teachers did 
exhibit a lower rate of group responses, especially group call outs, and 

' 'J 
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a higher rate of individual response opportunities, especially in nontum 

interactions (single questions occurring outside of oral reading turns) « 

There were unexpected findings for the use of **no feedback** to answers > 
in that the treatment teachers were more, likely to fail to give feedback 
than the control teachers, but only in response to correct answers, when 
* failure to give feedback is a less serious problem. 

Treatubnt teachers had a much higher rate of use of ordered selection, 
in which respondents were called on In order around the group* Correspond'^ 
Ingly, treatment teachers were less likely to rely on other types of select 
tion: Volunteering, preselection, nonvolunteers , and call outs« These 

« 

results were strongest for reading questions « 

There were no clear differences between the two groups in their use 

* »• 
of student comments (there were significant differences, but the means 

showed very low leVcl? of use In either group, and the direction Is not 

evident). There also were no differences between the groups in the use 

of undesirable questions, with both groups demonstrating very low levels 

of U8e« 

In general, the principles In this section were Implemented to dlffer-r 
ent degrees » with the strongest effects being on the use of Individual 
. response opportunities and ordered selection* In fact, the results for 
use Qf ordered turns probably were the strongest for any single principle. 
Apparently, the suggestions given about this in the materials were suffi- 
ciently clear and reasonable to encourajie the treatment teachers to try 

the technique, and their high implomcntat Ion of it suggests that It was 

\ 

useful to them. 
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Dealing with Individual Learning Rates within the Group (Prinoiplea 13,14,15, 6 16) 

Breaking up the group . Principles 13 «nd 14 were concerned vith 
breaking up the reading group whenever a few students were not meeting the 
lesson's objectives. It was suggested that one way to accomplf sh this was 
by teaching the more able students through to a certain point and dismissing 
them, in order to spend more time concentrating on those few students who 
were not meeting objectives. It was expected that the treatment teachers 
«K>uld do this more often than the control teachers. 

To measure implementation of this principle, observers noted for every 
observation of a group whether or not the group was broken up due to ability 
differences in this way, whether it needed to be broken up but was not, or 
whether it did not need to be broken up. The observers made these distinc* 
tlons on Lhe basis of whether one or two students in the group were notably 
behind that day, in their judgment. The observers also noted certain things 
about the way a group was broken up when it did occur « ^ 

There were no slgnj^cant differences between the treatment and control 
groups for the proportion of observations In which the groups were broken 
up, needed to be broken up, or did not need to be broken (5338-5340), 
The means for these three variables, respectively, for the control group 
were .01, .06, and .92, and for the treatment group were .03, .07, and 
.89. These results suggest that there was low Implementation of this 
principle in the absence of treatment, and that the treatment did not 
significantly increase the teachers' use of the technique. The results 
also suggest that there was less need for breaking up the group due to 
ability difterences than was expected beforehand. Th^» descriptions of 
the various ways in which groups were broken up were not analyzed, because 
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this occurred few tines. 

Using other students as aodels * Principle IS^^silggested to the teachers 
that they use other students as models on occasion to help those students 
who were having problems. It was therefore expected that treatment teachers 
would do this more than control teachers. Implementation of this principle - 
was to be measured by noting when it occurred, and how it was used when 
it did. However, no teachers used students as models at any time through- 
out the year. Obviously, this result represents failure to implement the 
treatment, and it demonstrates that this technique was not used by teachers 
in the absence of the treatment. Perhaps the content of first-grade reading 
instruction Is such that models are not as useful as they might be in other 
curriculum areas, or perhaps thie technique is difficult to use well, and 
the brief discussion in the treatment materials was not sufficient to 

« 

encourage its use. 

Providing extracurricular help . Principle 16 recommended extra 
tutorial help for students not meeting lesson objectives. Since this could 
not be measured directly with the observational system, pertinent data are 
not reported in this paper. Data will be presented and discussed in a 
later paper concerned with the teacher interviews conducted at the end of 
the school year. 

Sutmar y of prin c iplofi related "to dcalin (7 with individual learning rates 
within tht i group (Principle s T3fl4 ,15, S 16) , Principles 13, 14, and 
15 had worse Implementation tlian any otht\ group of principles. Although 
.t had not b'«en expected that the treatmentA teachers would use the suggested 
techniques on a dally basis, it was expected that they would use them more 
often than the control group teachers. However, there were very few 
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instanett of breaking up the s^oup because of ability dif ferencea in the 

* • * 

t 

way suggested, and 'there were no instances of use of nodels in either control 
or treatment classrooas* 

One possible con«. iusion Is that the behaviors suggested by these 
principles are inappropriate for first-grade reading groups, so that there 
was no implementation because the teachers Judged them as such. Another 
possible conclusion is that the techniques might be useful, but the minimal 
treatment was not sufhci^t. These principles were different from many 
of the others in that the^ were asking the teachers to, try something novel. 
Most of the other principles were asking the teacher to use behaviors already 
familiar to them, but perhaps more systematically. It seems likely that 
complex or novel behaviors will require more extensive treatment. The more 
a treatment or a program requires a teacher to change from his or her nomal 
repertoire of teaching behaviors, the more necessary it Will be to provide 
extensive rationales and opportunities for practice and feedback. These 

« 

were not provided In this study, and the datf. suggest that they were needed 
for the principles discussed in this section. 

Responding to Answers that are not Correct (Principles 1 7^18, S 19) 

Use o f terminal and sustaining feedback . Principles 17, 18, and 19 
were concerned with the responses teachers gave to answers that were not 
correct, including failures to respond. 

Implementation of these principles was measured with the low-Inference 
part of the observation system. For every academic interaction between 
the teacher and the individual student, the observer noted the type of 
selection, the type of question ar.ked. the quail y of the answer received 
(whether correct. Incorrect, don't know, or no response), and the type of 
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feedback given by the teacher to that answer. The categories of feedback 
which were related to these principles were terminal feedback* in which a 
student *8 opportunity to improve an incorrect answer was terminated and 
the answer was given, either by the teacher or another child, and sustaining 

» 

feedback, in -which the teacher stayed with the student who had made the 
mistake, and continued to ask questions or to probe in an attempt to help 
the student improve his or her answer during another interaction. 

Three categories of terminal feedback were used: the teacher could 
give the answer to the student herself; she could ask another student to 

give the answer to the child; or another student could call out the answer 

' ' — . 

* * 

before the teacher had a chance to give feedback* Sustaining feedback 
also was coded into three categories: the teacher could simply repeat the 

ft 

question to the student without providing additional Information; she could 

« 

give clues to the student In the form of simplifying questions which required 

another response; or she could essentially give the answer by a clue (by 

asking a very simple question with an obvious answer that allowed the 

student to make a correct response)* 

In addition to noting type of sustaining feedback » the observer would 

t 

note whether or not each use of sustaining feedback led to an Improved 

« 

response by the student* therefore, for each interaction Involving one 
of the three types of sustaining feedback ^ the observer noted whether it 
led to an improved response or an unimproved response* Improvement was 
considered to bt? any response following a "no response/' or s ome correct 
anuwer following an incorrect answer* 

It was expected that the treatment teachers would use mure sustaining 
feedback than the control teachers. It was also expected that the treatment 

'0 
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teachers would give the anever td the- students on occasion, when clues were 
not appropriate, hut would have a lower rate of use of this technique than ^ 
the control teachers, hecause clues or other sustaining feedback were 
suitable for most questions. It was also expected that the treatment teachers 
would have a lower rate of asking another student for the answer. 

As with other variables from the low-inference observation syst'H, 
results are reported in terms of absolute rates per unit of time, and . 
relative rates (proportion of possible times a particular behavior occurred). 
Variables are discussed separately for total interactions, for those occurring 
only in reading turns, and for those occurring outside of reading turns. 

There were no significant differences between the groups in the absolute 
rate of use of sustaining feedback (7). However, there was a significant 
difference (jg^ - .06) for the proportion of all interactions which were the 
result, of sustaining feedback (648; means • .12 for control, .15 for treat- 
ment). Separate analysis for nontum interactions yielded a significant 
difference between ^the two groups for the proportion cf interactions that 
were the result of sustaining feedback (652; ^ « .02, means » .11 for control , 
and .lA for treatment). 

For any noncorrect answer (incorrect, "don*t know," or failure to 
respond), the teacher had to use either terminal or sustaining feedback. 
Therefore, a score was computed for each teacher for the proportion of 
these interactions that Involved terminal feedback rather than sustaining 
fecJuw.k. Tb-!t is, when given a choice, which of the tw6 strategies did 
th< teacher use more often? There were significant differences in use 
of terminal 'feedback for total response opportunities (757; £< .01, means « 
.62 for control and .44 for treatment), but not for interactions occurring 



during reading turns (758; means » .66 for control and ,57 for treatment). 
There was a significant difference for nonturn interactions (759; £< .01 , * 

♦ * 

means « .52 fdr control and .36 for treatment). These data suggest that 
the treatment teachers were more likely to use sustaining feedback in 
situations where it was an option, especially in nonturn interactions, 
although they did not use it all of the time. Their proportionate rate 
of use was significantly higher than that of the control group, although 
the control group also had some natural implementation' it. the absence of 
treatment. Therefore, the result of the treatment was to increase the use 
of this behavior over the base rate of natural implementation. 

To examine use of feedback more specifically, variables were computed 
to indicate the extent of use of each of these separate types of feedback 
within the two major headings. When absolute rates per minute were examined, 
there were no significant differences for the use of any category of terminal 
feedback or for the first two categories of sustaining feedback (30-32, 
34, 35). There was a difference in the absolute rate for the third type 

t 

of sustaining feedback, giving the arisvcr by a clua (36; £ « ♦07, means » 
• 00 for control anO ♦01 for treatment) ♦ These means certainly do not 
indicate high Implementation by the treatment group, but they do indicate 
that treatment teachers wore using this behavior some of the tlme^ while 
control teachers hardly ever or never used this particular teihnique. 

Variables were computed which examined the proportion of response 
opport uni t irs whit h involved each o( tho separatt> types of feedbacks Wlien 
the propor t iiu.of total response opportunities whith ini*lude<i |ii^vo^«ujswer 
ffedb:u*k was vinnpared^ iht^re u.xa a <li f frrt hetu'fH-n tho rwt^ f.ruups in 
tht expect direction p ^ .07, means ^ . 1 for control and .0^ for 



^rcatmfent). When the data were broken down into turn and nontum Inter- 
actions, there were no significant differences (736. 737). However, the 
means indicate that giving the answer occurred much more frequently in turn 
roftponse oppcrt unities than nontum. Means for the two groups for the 
proportion of turn response opportunities which included giving the answer 
(736) were .49 for control and .41 for f>«s4tment teachers. Means for non- 
turn interactions (737) ware .03 for control and .OA for the treatment group. 

When the two groups were compared for the proportion of total response 
opportunities which included asking anothe r child for the answer, there 
was a stp.nlflcant difference in the expected direction (738; £ - .06. means - 
.05 for control and .03 for treatment). This variable was not analyzed for 
reading turn interactions, but a significant difference occurred with non- 
u;rn Interactions (739; £ » .04. means - .07 for control and .03 for treat- 
ment). Even though a significant treatment effect is present. the means 
Indicate that the i,roportion of interacwions In which the teacher did ask 
a.u^ther student was very low. This technique was not used extensively by 
these teachers in their reading groups even in the control group, although 
th,- treatment did seem to reduce this naturfjlly low level. 

Th re was a significatit difference for the proportion of total response 
onporfunltie.-. which involved students caJIlag out fecdbacK. and this was 
In the ixpecied dfrectlcn (740; p - .06. means = .02 for control and .C! 
U'v tre *"i*nO» Voen analyzed separately for turn Interactions, the differ- 
,n. «. was -u.- siKHifit^ant (741). Wlu>n examined only for nontum interactions, 
tht-rr VMK a Hifxnlffcant diflerenoe. hut the dir. 'tion was not detectable 
(.•..': i> ■- .0 1, moans - .01 for control and .01 for treatment). The same 
.•<.m I.:<*lon ran h.^ drawn for the use of call^out feedback as for a8k_o.tJ}e.r 



feedback. That Is, there was a low Incidence, even In the control /group. 
However, the treatment perhaps did sexve to reduce this slightly. 

The proportion cf response opportunities which involved the teacher 
repeating the question was not significantly different across groups (746, 
747, 748; means «» .05 for both groups for total intecactions) . This type 
of sustaining feedback was used infrequently in the control group, and 
its rate was not affected by the treatment. 

There were treatment effects for the otbar two types of sustaining 
feedback. The proportion of all response opportunities that involved- clue 
feedback was significantly different for the two groups in the expected 
direction for total R.O.'a (749; £< .01, mea.^ «- .06 for control and .09 
for treatment). The same variable was also significant for turn inter- 
actions (750; £ « .03, means « .13 for control and .19 for treatment), and 
nonturn interactions (751; £ » ,02, means « .06 for control and .09 for 
treatment). These result§ suggest that the treatment did increase the 
use of this feedback technique a small but sijjnlf leant amount, * 

The last variable of this type Involved the :roportlon of response 
opportunities involving give by clue fe€?dback* There were significant 
difference's f9r total interactions for this variable (752; £ « .02, means 
,00 for control and •01 tor treatment), and for nonturn interactions (75A; 
p < .01, means - ^00 and .01). There wort* no «i>;nifirant dlf^eiences for 
thi- variable for turn Interactions (753; means « ^01 and .O''*. lliese 
results suggest that this technique was not used much in the absence of 
treatment. The effect of the trcatmi-nt wa« not overwhelm! ng» but It did 
increase the teachers^ use 5;lightly» 

The proport ion« given for ahcwi' v;iriaMes arr li>w boc aust the 



« 

denomlnacor in this case 1« all response opportunities offered for either 
Utal, turn, or nonturn settings. This includes correct answers, which 
would* r.^t usually be occasions for these kinds of feedback. Therefore, 
the same types of variables were created for the specific types of answers: 
Incorrect, ''don^t know," and no response. These are examined in a later 
section. 

Because all te<»chers, both control and treatment, used both terminal 
and sustaining fee<Jback some of the time, each of these major categories 
w*s examined for the specific type of feedback used. It was expected that 
there would be times when terminal feedback would be the most sensible 
thing for the teacher to do, either because of the pace of the lesson or 
because of the type of question. However, when taking this option, it was 
expected that treatment teachers would be less likely to ask other students 
or to have call outs , and therefore probably would have proportionately 
more use of giving the answer . 

When the proportion of all terminal feedbat;^ which was filvtng the 
answer by the teacher was examined, there were no significant differences 
for total or i r rtiding turn response opportunities (760, 761; means for 
total R.O.*s were .62 and .72. and means for turn R.O.*s were .85 and .93 
for control and treatment groups, respectively) However, when only non- 
turn response opportunities were e-amined, there was a significant differ- 
ence between the two groups (762-, £ t .01, .neans - .29 and .51 for control 
and trentmont) . 

When the proper: Ion of all terminal feedback which was as king other 
students for ^ in-we" was excnilred, there was no significant difference 
for total response opportuni ties (7ft.i; means = .27 and .20), There i«s 
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a significant difference for nontum interactions (764; £ «• ♦01, means - 
.57 for control and .39 for treatment). This variable was not examined 
for reacting turn interactions alone* 

« 

The proportion of terminal feedback which was a call out bv another 
student before the teacher could respond was wot different for the treatment 
groups for either total interactions (765; means « .11 and .Od), turn inter- 
actions (766; means - .12 and .07), or nontum Interactions (767; meaits « 
.lA and .10). 

These data on types of terminal feedback suggest that the treatment 
group was relying more on the teacher giving the answer herself than on 
asking or allowing another student to do so, while the control group was 
more likely to ask another student, especially Ih^nonturn interactions. 
This represents a treatment effect, although it is evident that both groups 
of teachers used Stll techniques some of the time. The treatment effect 
therefore was to modify the frequency with which each technique was used, 
not whethoi* or not It v 38 used. 

The tlireo types of sustaining feodhack were examined in the same way. 
There were no significant differences for any type of Interaction for the 
proportion of sustaining feedback which was repeating the gu^ticn. The 
means for total interactions, for the control and the treatment groups 
respectively, wcro .Al and .32 (768). For turn intoractions they were 
.42 and .V> (7(>9), and for ponturn interactions they were .41 and .33 (770). 

There''wcro also no significant differences in the proportion of time 
that chio feedback was used to sustain an interaction, (771 , 772, 773; 
means for total Interactions were .55 and .61, for turn interactions .53 
and .60, and f<»r nonturn interactions .55 and .60). 
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There were significant differences in the proportion of all iiuatainl»ig 
feedback which was ^ive by clue feedback, for total Interactions (774; 

♦ 

2 - .07» means • .04 and .Ot). This was not significant for turn interactions 
(775; means « ,04 and .05), but It was for nonturn interactions (776; .01, 
means • .03 and .07). These results suggest that both treatment and cont/ol 
teachers used the techniques of repeating the question or offering clues 
to the students about the same proportion of time that sustaining feedback 
was used. (Remember, however, that the rate of use of sustaining feedback 
In general was different for the two groups.) However, very simple clues 
that essentially gave the answer to the student but which allowed him or 
her another response opportunity were seldom used by either group, but 
more often by the treatment jteachers. Possibly this technique is not one 

t 

that is readily apparent to teachers; and discuseing It in the treatment 
made many treatment teachers aware of it. However, it was still not used 
by the treatment teachers as much as other, more typical types of sustaining 

♦ 

feedback . 

Feedback to "no respo nse" answ ers. To exaniine the use of each feedback 

technique more cJocely. variables were created which examined particular 

\ 

subsets of response oppo'-tunlties defined by the type of answer involved: 
n^LX'^^'^JlSe* \r}:?SSJSS^S:.> " don't know ." The denominator of the prop-ortlon 
therefore becomes, for example, "all n o resp onse answers;' rather than 
"all response opportunities." ^ 

There were no significant differences between the two treatment groups 
on the absolute rate of no rcspons j? answers per minute (23; means - .15 
for '^ontrol and .12 for treatment). However. Vher- was a dlffer«»nce between 
the two groups for the proportion of total response opportunities which 
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fiere no veerowse answers (698; |> • ♦06, means ■ ,14 for control and .10 for 
treatment group) . When this variable was broken down. Into turn and nontum 
interactions, there i*ere no significant diff«»rsnce8"~t699, 700). 

The proportion of no response answers which were responded to by the 
teacher giving the answer to the student was not different for the two groups 
for total interactions (833; means • .42 and .32) or for turn interactions 
(8^4; means - .61 and .53). However, there was a significant difference 
for the use of this technique following o response in nontum interactions 
(835; £ « .10, means » .12 and .18). 

When the use of ask other feedback In response to no response answers 
was examined » thex^e was a significant difference for total interactions 
C836; £ X* .07, means «* .16 and .08 for control and treatment respectively), 
and also nontum Interactions (837; £ < .01, means » *31 and »12). 

* 

This variable was not examined separately for tyrn interactions. 

The proportion of no re^onse answers which Involved another* student 
calling ou t feedback showed no significant differences for total Interact ions 
(838; means « .09 and .05) or for turn Interactions (839; means « .10 and 
.04)^ However, there was a significant dlffetence for nontum interactions 
(8A0; £ « •Oe, means « •ll and .OS)* 

There were no differences for the proportion of no* response answers 
which received feedback In the fonii of r ep ea t in j* ttio quest Ion (8AA> 845, 
846; means for^^otal interactions were ,10 and •12 for turn interactions 
they were eO? for both groups; and for nontum interactions they were •14 
and .16 for control and treatment, respectively). 

However,^ there v^re significant differences for the proportion- of 
no response answers which were followed by clues in total interactions 
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(8A7; £ .<*01, means • .21 and .37), turn Interactions (8A8; £» .02»^ 
means " aS and .32), and nontum interactions (849; £ - .OA, means " .27 
and .40). 

Likewise, when the proportion of no. respon8e> answers receiving give^ ^ 
by^clue feedback was examined, there wer<» significant differences for all 
types of interactions: total (850; £ < .01, meaus • .01 and .05), turn 
interactions (851; £ «* .08, means « .01 and .03), and nontum interactions 

♦ 

(852; £ • .01, means • .02 and .06). 

To summarlrfc the data on teacher feedback to no response answers , the 

proportion of times teachers used either clue or tivc-by^clue feedback was 

.) 

slgaificantly higher in the treatment group for all three types of inter- 
actions. The frequency of use 4»f asking another child for the answer was 
significantly lower for the\ treatment grcujj> for nontum, and total inter- 
actions. (This was not analyzed separately, for turn interactions.) For 
nonturn interactions only, there were also differences between the two 
groups in the expected. directions for giving the answer and having other 
stjiidonts call out the answer when sustaining feedback was not used. That 
Is, the treatment teachers used giving .ihe answer much more often than 

either of the other two terminal feedback techniques, while the control 

> 

teachers were more likely to have students call out the answer, or to ask 
another student to provide it. / 

During reading turn interact ions « both treatment and control teachers 
were mct;t lik*=^ly to give the answer following no^ response . However ♦ this 
was not true for nontum interactions, when the most common response for 

the treatment teachers was to give a clu*^» and for the control teachers » 

« 

to ask o iher child for the answer. SJncc the teachers wcr^ prob.ibly 

} 
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trying to* m&intaln a faster (^ce in reading ttirns , it made sense for them 
to give the answer to the student then* However, even in the reading turn 
situation, both groups of teachers used clues or other types of sustaining 
feedback some of the tir^^ although the treatmeiit teachers were more likely 
to use it, especially clue feedback, than the control teachers. 

These results can be interpreted as representing a fairly strong treat- 
ment effect characterized by an increase in the treatment teachers* use of 
sustaining feedback > espe<blally clue feedback and g ive by clu e feedback ^ 
and a decrease > especially for nonturn interactions » in their use of asking 
another student for the answer. These are the behaviors specified by the 
instructional mo^el. I 

Feedback to incorrect answers . The same variables were examined for 
incorrect answers. In addition to looking at the six categories of feedback 

« 

already discussed t the failure to give feedback ( no feedback) and the use 
of emphasis feedback^ were also examined for incorrect answers ♦ No feedback 
was recorded by the observer when the teacher did not acknowledge the 
incorrectness of an answer and did not provide the correct answer. (This 
Is related to variables discussed for Principle 7.) Emphasis was recorded 

I 

whenever the teacher made a special effort to indicate what the answer was 
by repeating it* These two behaviors are relevant to examination of the 
princlploH because it was emphasized In the mode) that the teacher should 
communicate to the students when an answer was wrong* 

There were no significant differences for the proportion of incorrect 
answrrs which were responded to wfth n o feedhcic k» for either total inter-* 
acvlc/ns (793; means for both wore .00), or nonturn Interactions (794; means 
for both ^ .01). This variable was not examined for turn interactions. 

» 



Ther^ were also no differences in the proportion of incorrec^enswers 
responded to with emphasis for either total Interactions/? 95; means • .00) 
or nonturn interactions (796 j means for both - .01) • Obviously, neither 
group responded to incorrect answers often with either of these types 
of feedback. 

When the proportion of incorrect answers responded to by the teacher 
^ivin^ the answer was examined, there were no significant differences between 
the two groups for total interactions (803} means • .39 and .32), turn 
^teractions (804; means • .55 and .52), or nonturn interactions (805; 

means .16 and .18). 

There were differences between the two groups for the proportion of 
incorrect answers responded to by the teacher asking another child for both 
total interactions (806; £ .04, means - .15 and .08), and nonturn inter- 
actions (807; 2 - .01, means - .28 and .14). This variable was not examined 
separately for turn interactions. These results are in the expected direc- 
tion, with the treatment teachers a sking others less often than the control 
teachers . 

The proportion of incorrect answers responded to by other students 
calling out the answer showed no differences between the two groups for total 
interactions (808; means - .04 and .03), or for turn Interactions (809; 
means .04 and .03). However, tliere was a difference between the groups 
for this variable in ronturn interactions (810; £ - .09. means - .04 and .02). 

There were no differences between the two groups for the proportion 
of incorrect answers which were responded to by repeating the question for 
♦either total Interactions (814; mean^ - .21 and .22), turn Interactions 
(815; means » .23 and .20), or nonturn Interactions (816; means • .22 and .23). 
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However, there were significant differcuces for all types of interactions 
for the proportion of incorrect answets responded to with dnes t total 
inteuictfons (817; £ < .01^ means • and .30), turn interactions (818; 
£ .08i means » .14 and .22), and nontum interactions (819; £ •» .02, means • 
.24 and .35). 

The proportion of incorrect answers responded to with giving the answer 
by a clue was not different for the two groups for total interactions (820; 
means - ,01 and .03), or turn interactions (821; means « .02 for both groups). 
However, there was a slgaificant difference for nontum interactions (822; 
£ " .06, means • .01 and .03). 

In order to determine if types of teacher feedback to errors differed 
according to types of question, incorrect answers were analyzed for different 
types of feedback to reading and nonreadlng questions. These analyses 
.revealed that the same pattern reported for incorrect answers as a whole 
was consistently found for both types of questions. That is, there was 
more use of sustaining feedback and less use of asking another student by 
the treatment teachers. (See variables 888-895, 899-907.) 

To summarize the variables which describe teacher responses to inco r- 
rect answers, a pattern of results emerged which is similar to that for no 
response answers. That is, the treatment teachers had a higher relative 
use of cUic feedback., and» in nontum interactions only, give by clue feed- 
back, suggesting Implementation of the principles describing simplification. 
There al«o were differences' between the two groups in the frequency with 
which they used asking another student for the answt^, with the treatment 
teachers havlnp, a lower frequency of use th<iW.the control teachers. These 
results suggest that Principles 18 and 19 were often implemented by the 



treatment teachers when dealing with Incorrect answers. 

Feedback to "don*t know" answers . »1)on*t know" answers were also 
examined for the types of feedback given to them. The proportion of "don^t 
know" answers which were responded to by the teacher^v^tvlng the answer was 
not different for the two groups for total interactions (823; means - .29 
and .28), turn Interactions (82«; means - .60 and .56), or nonturn interactions 

(825; means • .12 and -18). 

The proportions of don*tHcnow answers responded to by asking another 
child for the answer were not different for the two groups for total inter- 
actions (826; means - .17 and .12). but they were different for nonturn 
/ interactions, with control teachers using the technique more (827; ^ • .08, 

means *■ .27 and «16). 

The use of other students calling out answers In response to don*t 
know answers was not analyzed due to low frequency of occurrence. 

The proportion of "don*t know" answers responded to with the teacher 
repeating the question was not significantly different for either total 
Interactions (828; means - .11 and .08). or nonturn interactions (829; 
means - .11 and .08). This variable was not examined for turn interactions. 

The proportion of d on't kno w answers responded to with a clue from 
the teacher was significantly different for the two groups for total Inter- 
actions (830; £ » .03. means « .23 and .36). This variable was not examined 

> 

for turn interactions. bu> It was significantly different for nonturn 
Interactions with troa.tmcnt teachers using clues more (832; £ » .05, means • 
.19 and .36). 

Tho use of ^.ivlng the a nswer by a clue as feedback to don*t know 
answers was not examined because of the low frequency of such occurrences. 
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Although the results for (jon*t nov answers were not as strong as for 
no response and incorrect answers (possibly due to the lower frequency of 
* *don*t know" answers), similar patterns existed in that the treatment teachers 
were more likely to use sustaining feedback in the form of clues > and less 
likely to use asking another child for the answer. Again, there were no 
differences between the two groups in the teachers* giving the answer to 
the students* 

Improvement resulting from s taining feedback s When sustaining feedback 
was used, its iimaediate effect was noted the observer as either improvement 
or no improvement* Improvement did not necw««sarily mean that the final 
desired answer was reached in the next interaction, but that the student had 
answered some question correctly or had otherwise improved his previous 
response* 

When the absolute rates per minute of improved and not improved responses 
wer«» examined, no significant differences were found between the two groups 
(37, 38; means » .08 and .13 per minute fct* improved responses, and .OA 
and .05 for unimproved responses). 

As an index of the teacher's relative effectiveness using sustaining 
feedback, the. proportion of all sustaining feedback which led to an improved 
response was computed. There were no significant differences between the 
two groups on this measure for total" Interactions (93A; moans " .68 and .73), 
and turn interactions (935; means " .73 and .77). However, there was a 
significant difference for nontum interactions (936; £ - .04, means « .63 
and .70). These results suggest that the treatment teachers were slightly 
m->rc effective with sustaining feedback, at lenst in nontum interactions, 
although all teachers wore generally successful in improving responses. 



Each type of answer ^aa examined for the proportion of al^ auch answers 
which were Improved, and the proportion which were sustained and Improved. 
For incorrect ansvers, the proportion improved was significantly different 
for the two groups (937; £ < .01, means - .27 and *39). However., there 
were no differences between the two groups for the relative effectiveness 
of sustaining feedback to incorrect answers (938; means • *68 and .72 of 
all sustained incorrect answers improved). Therefore, the treatment group •s 
higher level of improved incorrect answers was probably the result of higher 
use of sustaining feedback, and not just better use of sustainitig feedback 

when It did occur. 

When don»t know answers were analyzed, there was a significant differ- 
ence between the groups for the proportion of all don*t know answers which 
was improved (939; £ - .03, means » .19 and .35). When examining only 
don*t know answers which were given sustaining feedback, the proportion 
of these Chich were improved was also significantly different for the two 
groups (940; £ - .08, means - .53 and .66). Not only did the treatment 
teachers tend to use more sustaining feedback in response to don*t know 
answers, leading tc more improvement overall, but they tended to be slightly 
more effective \»ith such sustaining feedback when it was given. 

Wlien no response answers were examined, there was a dlff^jrance for 
the proportion which was improved (9A1; £ < .01, means • .21 and .AO). 
Howevex:, there war no difference In the relative effectiveness of the 
treatment and control teachers in their use of sustaining feedback to no 
response answers (9A2; means « .68 and .7A). 

Tc sumtnarlzf the variables describing Improvement, the treatment teachers 
were sometimes slightly more eftcctive in getting Improved responses with 
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their sustaining feedback, but this difference was not as notable as their 
greater use of such feedback. 

Many times » teachers* use of sustaining feedback led to. a sequence of 
Interactions in which the teacher continued to give clues until the student 
got the answer right or until terminal feedback was eventually provided. 
In order to describe the lengtH of such sequences » a variable was computed 
which measured the proportion of sustained interactions which received 
terminal feedback rather than further sustaining feedback* This represents 
interactions that were attempts to Improve a child *s answer but did not 
result in the final answer desired by the teacher, to that she had the 
choice of cither continuing the sequence further or terminating. Therefore, 
the higher the proportion, the more likely was the teacher to terminate 
before success. 

For total interactions, there was a signif leant difference between the 
groups for the proportion of sustained Interactions which were terminajted 
by the teacher (662; £ « .03, means « ♦AS and .35J. However, when broken 
into turn Interactioiis and nonturn interactions, there were no significant 
differences (66;K 664; means for turn interactions wore ..49 and ^37, and 
means for m>uturn Interactions were •45 and .37) ♦ Thtse data suggest that 
overall > the treatment teachers were likely to contimto a sustaining sequence 
longer than tlie control teachers* That Is, they were less likely to use 
terminal feedback within such a seqtienco and more likely to give further 
sustainin}> fe/dback, although they freiuiently did termin/ite before success. 

Kach type of suslainlug ieeiJhaek was analyzed to si*e hi>w often It led 
to an lmprove<! re.»«ponse» and the two r,roupK of teaohcrs w^»ro compared to 
see if s>n<* wa;; more effective with a parti<MiIar type 4>f teedhack than 
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another. There was no algnlf leant difference between the two groups for 
the proportion of repeating the question feedback which led to Improvem it 
for any type of Interaction: total (944; means • ^.68 and .69) ♦ turn (945; 
means •» .74 and. .78>, or nonturn Interactions (945; means - .63 and .65). 
These means Indicate that repeating the question usually was successful 

* • 

when used, espeq^lally In reading turps. ♦ . 

When examining the proportion of clue feedback which led to an improved 
response, no differences were found between the* two groups for total inter- 
actions (947: means » .67 and .72), or turn interactions (948; means • .71 
and .74). However, there was a significant difference between the two 
f.roups for nonturn interactions (949; £ « .04, means « .62 and .71). When 
treatment teachers used clues in nonturn interactions, they were relatively 
more effective. 

There were no* dif fercJncea between (he two groups for the proportloft 
of filvl np by clu e feedback which I'^d to Improvement (950, 951; for turn ^ 
interactions, means • .79 and .81'. and for nonturn interactions they were 
.81 apd .86). These, results suggest that this type of sustaining feedback 
was easiest, as expected, although It did not absolutely guarantee a correct 
answer . 

^xxmmr^ of re sults for princ iples relat ed to feedback to answors that fi'rc 
not^correct ^P rinciples 17,18, &_19). Th^s group of principles as a whole had 
the strongest Implementation of any ill bhe instructional model. There was a 
basic pattern observed In all three types of answers (incorrect , noj^esppnse, 
mid donU know) and both major typt'S of quostiohs (riNidlnjj and nonreatinj^) 

« 

As oxpot ttd, t n-nt men t toachcrs used more sustaining feedback, especially 
cluos, and used less feedback which involved asUjig^ an^^^^^^^ for 

« 
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the answer; There were fewer ifj|tances of other students c alling out 

feedback in the treatment classrooms. The two groups were similar }fi 

their rate of pivtng the answer > especially during reading turn interactions* 

In .general, the differences between the two groups were strongest 

in itttercctions occurring outside of reading turns, during.- question and 

answer sequences. It is probably during such interactions that |he teach<»r 

can exert more choice about wha^ klhd of feedback Co use, since the pace 

is different. In oral reading turns, correcting mistakes as quickly as 

* • • • 

possible may be necessary to. prevent Interruptions of Itentence or story 
meaning . 

• • * 

The treatment teach'^rs were also slightly more effective with su^jtaining 

feedback than were the control teachers, when effectiveness was defined 

as yielding some improvement in the next Answer « It is possible that they 

were concentrating more on thf purpose 'of sustaining feedback, since the 

treatment materials had discussed Why it should -be beneficial^ Perhaps 

♦ 

this is ,a case of a self-^fulfilling prophecy on the part of the treatment 
teachers: they believed that sustaining feedback should help,^and there^ 
fore they were working harder at using it, and, %in the process, made it 
more useful to the students* The control teachers, on the other hand, may 
have had no particular^ expectations about the efficacy of ^ the technique, 
* and therefore may not have trim! so , hard to be effective witlyit. Th^s 
difference between the groups is interesting because the purpose ♦of the 
treatment was to increase the frequency of sustaining feedback. Nothing 
was said about ways of u&ing it more or less effectively* 



Principle 20 HUR>»ested to the teachers that they should respond to 

0 

; ^ 
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correc^t answers by some kind of «cknowl«:dglng feedback, and by making 

sure' that all of the students heard and understood the answer. It was 
sugi.eHti*d to the teachers tliat they should, when necessary, tepeat the answer 
or have It repeated, although this should net be overdone/ Implementation^ ^ 

ir 

of this principle was measureii by ioting\the proportion of time that correct 
answers vtv^ folloyed by no feedback- , and the proportion 'of Mme that the 
teacher erop haslzed the answer by r'^peatlng It or having it repeated. It 

* 

♦ 

was expected that treatment teachers would havo a *lower rate of no feedback 
and a higher tate of emphasis- feedback. 

There were no significant differences between the two feroupj» in the 
absolute rate f/f no feedback (24; fce^ins * .06- and .10) or emphasis (25; 
mtfans • •26 and ^•23)* 

The proportion of correct answers receiving no feedback was ^ignl f Icantly 
different for total interactions (778; .iO, means • .OA and .10) -and 
for nonturn interactions (779; £ « .09, means - .05 and .11). These roMults 
are not in the direction expected, because the treatment teachers Vera 

# 

giving feedback to correct answers less ofteh than the control teachers 
were." Indeed, the treatment group*8 means indicate that about one* of every 
ten cga?rect answers was not even acknowledged by the teacher. ^ 

The proportion of correct answers which received emphasis was signi- 
ficantly different for total interactions (780; £ » .10, means » ,40. and ; 
.31), and for nonturn Interactions (782; £ »' ,07, means - .43 and .33). 
However, there was no significant difference between the two groups in 
the proportion of correct answers receiving eiuphasis In turn interactions 
(781.; mvimr, « .09 and .04). AR.'iin, this result was unexpected. Control 
tc::rhers were emphasizing correct answers more often than treatment teachers. 



Although (he treatment did not recommend the use of emphasis for every answer, * 
it was hypothesized that there would be. a greater frequency of this for the 

« 

treatment group, because the treatment had emphasized making sure the students 
knew what the correct answer was. Perhaps the treatment *did make the teachers 
-more aware of problems invol\?ed with repeating answeits. If so, it might 

* 

have served to decrease their use of this technique* 

. Th6 observers also noted the teachers* responses to reading turns when 
they were completed correctly. There was no difference between the two 

* 

groups- in the use of no feedbac k in this situation <853; means * .22 and 
.24) or In the use of emphasis feedback (854; meapi .12*ana .08). It 4s 

♦ 

* » 

interesting to note that, for botK groups, over a fifth of all corrett 

m 

reading turns were not-acknowledged at whe end by the teacher, 
♦ . ♦ • * 
In order to determine If feedback to correct' answers was different 

according to type of question, the proportion of corjrect reading questions ^ 

* which received no feedback was computed ♦ Ther^e were no significant differ- 

cnccs for this variable for either total Interactions (861). or* nonturn 

interactions (862), although the means are ordered as they were for other 

variables, with treatment teachers more likely to omit feedback. 

The proportion of c'»rrcct answers to reading questions which received 

ompha.sts was not different f<>r the two groups for total interactions (863; 

means « .37 and .27), or turn interactions (864; means - .09 and .04). 

However, there was a significant difference- in nontu^.t Interactions (865; 

£« •06, means - .At and ,31) • Again, the control teachers emphasized 

correct an«wori$ more* 

However, when correct answers to nonrondinfi questions were examined, 

there^ W4*re no differences between the two groups for measures of no fee dback, • 
. -A 



(908« 909) or for itse of emphasis feedback (910, 911 )« • 

Smmary of results for feedback to correct answer^i (Principle 20) . 
Principle 20 was not Implemented as Expected. In fact* the results were * 
opposite to those predicted* 

* 

Treatment teachers were more Xlkely thatr cont^^ teachera to fail to 
give' feedback in .total and nonturn interactions^ However^ the difference 
v<%8 not highly significant, and It did not hold up when examined separately 
^ for different types of questions. One possible explanation of these \inex- . 
pec ted results is that .feedback to correct answers is no.t as Important as. 
originally believed, and. that teachers were using it only when th^ felt 

• • • 

it was necessary. Perhaps there was something about the treatment classes 
that made feedback to correct answers less necessary than in the control 
classes. However » there is nothing apparent in the treatment that could 
account for tl»ls. 

The control teachers used, emphasis more often in total and nonturn 
interactions, although the results were significant only at the .10 level. 
When broken down by question tyod, this pattern was maintained only for 
nonturn interactions with reading questions, Th^^ treatment did not specify 
that cmph as.^s should follow every correct answer, but only that the teacher 
should make sure that everyone heard. In fact »^lt* mentioned that there 
could be problems with too much emphasis by -repetition. Perhaps this made 
the treatment teachers more aware of potential problems, and tl\erefore 
lessened their tendency to emphasize answprs. 

" ' / • 

Prainc and Criticism ( Princi plo ts 2 1 6 22) / 

Principles 21 anvl 22 made suggest Ions/about the use of praise and 

/ 



criticism. It was elcpected that the treatment teachers would use less pr^is.e 
and that they would be more specific with their praise 4nd criticism^ ^ 

Praise e The use of praise Vas poted in the low inference part of the 
coding system as a type of feedback to response ppportunitieSt and as a type 
of teacher response to studenf: behih^iors« 

When absolute rates per minute were examined, there were no significant, 
differences for the rates of response opportunity praisg (27; means « .1^ and 

• 08) or behaviora l praise (425; mems ^ •00 for both groups)* 

However > there was a significant difference between the two groups for 

the proportion of all contacta* (response opportunities plus behavioral con^ 

.* • • • 

tacts) that Involved praise (1033; £ » ^02, means • ,12 and •07)^ When 

praise was examined just for response 'opportunities, there was a significant 

* 

difference between the two groups for total interactions (730; £ ■» .02, 

means » .lA and .07), and for nontum interactiotis (732; jg^ < .01, means * 

.16 and .07). However, there were no differences in the use of praise in 

turn interactions (/31; means « .02 and .01). These results support the 

hypothesized treatment effect for lower incidence of praise in the treatment 

group/ at' least for nontum interactions, where most praise was' given. 

There was no significant difference between the two groups in the proportion 
♦ * 

of behavioral contacts that included praise (lOlA; means » .03 and .OA). 

* # 

When only correct answers were examined ♦ there wore significant differ- 
cnces between the two groups'for the proportion of correct answers that 
were praised in total interactions (785; p « .01, means » ,1A and .08), 
turn interactions (786; £» .09, means * .10 and .05), and nontum inter- 
actions (787'; p » ,01 » means « .15 and .08). Therefore, when only correct 
answers were considered, the treatment effect for the frequency of praise 



vas stronger, with control?' teachers praising about twice as often as treat*- 
nent Wachers. 

The proportion of r<?ading turns* that were completely correct and given 
praise was not significantly different for th* tWb groups, although there 
waa a trend in the same direction (855; means « *22 and.«12). 

When broken down by type of question, the proportion of correct answers 
to reading questions that received praise was significantly different lor 

* ^ ^ ^ • } 

total interactions (868; £.< .01. means « .20 and .09), for turn interactions 
(869; £ - .09. means •» .10 and .05). and nontum interact£ons (870i £ < .01,. 

means « .11 ^nd .09) • ♦ * ^ 

Ijhcn nonreading questions in nonturn interactions were* examined ,^J:he 

« 

proportion of correct answers that receiyed praise was not significantly 
different for the two groups (915; means - .07 and .05)*. Therefore, it can 
be concluded that the treatment effect was strongest for reading questions 

that led to correct answers. 

The use of praise following incorrect answers was also examined. This 
occurred •'when teachers tried to praise some part of an answer, even though 

♦ 

it was incorrect. The«proportion of incorrect answers that received praise 
in total interactions was not- significantly different, for the two groups 
(799; means « .01. and .00) . but there was a significant difference in non- 
turn interactions (SOpj p. - .09. means » .01 and .00). Eveft though slgni- 
ficant. the means do not indicate a large difference. 

Reading turns (as a whole) that contained some mistakes. were also 
praised some of the timo. and the proportion of these which received praise 
did not differ significantly for the two p.roups, although there was a trend- 

* 

suggesting that control teachers gave more praise in this situation also 



(859j means « #23 and ,13). y ' 

Incorrect answers to reading questions were examine^ for the proportion 
followed by ^raisd',. and 'there were no significant* differenced between the 
\v6 groups/ for ei^ther total Interactions or nonturn Interactions (884, 885) « 
In both cases* the means were .Ol for the control group and *00 for the treat- 
ment group. It was not possible to analyze Incorrect answers to nonreadlng 
qiestlons that received praise, because this happened so seldom. 

* 

One of the more Important points of principle 21 wa^ that praise, when 
given, should be specific as to what was being praised* The proportion q,f * 
all praise that was specific^ differed for the two groups C1034; £ « «04, 
means «* .p3 and .07), When only academic praise was examined, the proportion 
'that was specific also differed for t^e two groups (756} 2." *^^* ** '^.^ 

» 

and *06Ia There was not a significant difference between the two groups in 

the proportion of behavioral praise that was specific (1029; means »* «4A and 

.34). Perhaps behavioral praise is specific more often because It is typically 

> 

given only when the jteacher wants to point nut a behavior with which he or t he 
is pleased « Academic praise » on the other hand» tends to be a simple stater 
mcnt of **Good** following a response* and apparently it^is. meant to acknow- * 
ledge and praise the correctness of the answer* It may be more% difficult 
to specify » or perhaps it is less necessary to do so because the referent 
will be understood ♦ 

These data suggest that the treatmet^^ did have some effect in increasing 
the specificity of praise and decreasing the total amount of praise given by 
the treatment group* However* there was pot high Implemcmtatlon of speci-- 
ffcity by the treatment group, only greater implementation than the eontrol 
group , 

> 

■ .} 
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Criticism . Vien the two groups were examined for the absolute rate of 
academic criticism per unit of time, there was no significant difference » 
with both groups having a mean rate of .01. per minite (28). Likewise, there 

was no significant difference for the rate of behavioral criticism given, 

•* 

although the means were slightly higher (A29; means *» .03 and .02 per minut^^ 

The proportion of all contacts that were critical in natute did not 
differ for the two groups, although the control ^roup was slightly higher 
than the treatment group (\035; means » ,08 and .05) ♦ 

Whan response opportunities were examined, again there was^no signi- 
jficant difference in the proportion of response opportunities receiving 
criticism for either total or nonturn interactions (733, 734), In both 
cases, for both groups, the mean was IX of all response opportunities 
Veceiving criticism. Obviously, there was little academic criticism given 

# 

in either group « 

When only incorrect answers were examined, again there were no signi- 
f leant differences between the two groups for either total interactions ... 
(801; means - *01 and .02) or nonturn interactions C802} means « ..02 and 
.03). When analyzed separately for reading questions and nonreadlng questions 
again there .were no significant differences between the groups for either 
total or nonturn interactions in the re'lative frequency of criticism to 
incorrect answers (886, 887 » 92.1) ♦ 

Principle 22 die not encourage criticism in the treatment teachers, 
so it is not surprising that there were no differences in the relative 
use of criticism. However, the principle did encourage a more specific 
use of crltlrisiTJ when it was offered. When all contacts involving criticism 
♦or correction of some kind were examined, there was no difference between 
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the two groups in the proportion that was specific (1036; means « ,06 and . 
.07). This variable Included not only academic criticism, but also correc- 
tion delivered by the teacher for students* misbehavior. These corrections 
m<ght or might not be considered critical, but they were definitely correc- . 
tivc in nature. One type, the behavioral management abatement (a relatively 
mild correction), was examined separately for specificity. There were no 
significant differences between the two groups on the* prop'^rtion of these 
that were specific, with means for both groups being .09 (1030). The 
proportion of total behavioral contacts that were specific demonstrated no' 
group difference, with the means being .10 for each group (1019). 

These data suggest that there was some natural implementation of the. 
principle in the control group (6^ of all critical and ^irective comments 
were specific, and 10% of all behavioral corrections were specific), b-*- 
the treatment did not increase t^e behavior of the treatment teachers above 
this base rate. Therefore, there was no evident treatment effect for 

« 

Principle 22 and its suggestions about use of criticism, 

Sunanart; of results for praise and criticism (Principle 21 s 22) . 
Principle 21*, describing ways of using praise, was implemented to some 
extent. Treatment teachers used less praise, which is interpreted to mean 
a more moderate amount of praise. This was most apparent following correct 
'answers to reading questions. There was some treatment effect for use of 
specificity with praise, in that thtf treatment teachers were more spectfic. 
but they did not use specificity very often, so this cannot be Interpreted 
to mean strong implementation of the i>rinciplc. 

Prim fplc 22 su>>,nt>ste<r that crlticfsm, should bo very specific when 
delivered. There were no differences between the two groups for any measures 



of thl». Coutrol jteachers were already being specific about lOX of the, 
time, and the treatment teachers* use of specificity was.no greater than 

theirs. ... • . j 

Many other variables were derived .from the observatloA system which 
did not directly measure implementation. However, in otder to determine 
if the two groups of teachers differed in other ways, other groups of 
variables are also reported. 

Tiwe Usage ^ 

There were no significant differences between the twp groups for either 
the average total time for. reading groups, which included tranAtion time 
plus R.O. time (A035; means « 26.*26 minutes for control and 26.85 minutes 
for treatment), or for the average response opportunity time available 
within that period (4029 .t means - 22^53' minutes and 24.02 minutes). 

Several varlablea indicated the rate at which the teacher gave response 
opportunities of various kinds to the students*. Some of these have already 

been reported as measuring implementation of Pi^lnciple 7j total R.O/s 

/ 

per minute. (601; - .07. means « 1.86 and 2.^^0.per minute), and nonturn 
R.O.'s per minute (602; .02, means - 1.20/and 1,64 per minute). There 
were no significant differences between the two groups of teachers In the 
rate at which they offered reading turns (603? means - *40 and .36 reading 

i 

turns per minute) , or in the overall r^e per minute of response opportuni- 
tics durinp, reading turns (604} means « .65 and .56). 

There was a significant difference between the two groups in the 
proportion of all respovno opportunities that occurred during reading turns 
(605; £ » .05, means « .36 and .26), However, within each reading turn,^ 



• • • 

• ^ * 

ther6 were no differences b^t^feen the average number of response opportunities 

per turn (606; means - 1/^6 and 1.56). Therefore, the difference between 

the two groups for the proportion of totoX response opportunities that occurred 

during reading turns Is probably due to the higher frtquehcy of nontifrn 

response opportunities per minute in the treatment group. This has already 

been discussed with regard to Principle 7. 

Because the treatment group was usinR more sustaining focdDaok, and 

because each use of sustaining feedback led to another response opportunity ^ 

it might be argued that the higher frequency of response opportunities wab v 

due to a higher rate of sustaining feedback. In fact^ the proportion of 

all response opportunities which were InUlal selections rather than sustained 

select-ions showed no differences between the two groups (6A5; means for 

• • • 

each group « %66) ^ The other 3A% of response opnortunit les (which were 
not initial selections) were due oither to sustaining feedback or to the 
teacher continuing with the student by asking a new question after giving 
an answer through terminal feedback* 

0 

To suimarize data on the ways that time was spont in the reading groups, 
it can be seen that> on the average^ teachers in the two groups spent about 
the same amcunt of total time teaching reading in their groups, but the 
treatment tt»arhc»r« managed to present many more response opportunities 
in nontura situntir)ns* This moans that they Wi>re asking mure single 
ouestions^ but tfiey were not having students read aloud more times than 
thv control t<arhers» 

Obseivers noted the lesson ct>utext« in whicli respoiKse opportunities 
ocetirred. Five rontexts were nstu?: a) sh^w-ia<'e*f qne«t funinj* and answ«»ring 
without U5>e of .1 workbook* a workstieet ^ or l>asal rtMdi*r; 1>) workbook or 

* 
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worksheet activities; c) fast paced drill; d) reading a story aloud from 
the basal for the first time; e) reading a story aloud from the basal that 
has been read previously in the group. There were no significant differ- 
ences between the two groups for the average time spent in any context 
or the proportion cf response opportunity times spent in any context (4030-* 
A034, 4063-4067). * • . 

Whenever a teacher was In the process of teaching a lesson and had to 
leave the group for any reason, the observer noted this and timed her, absence 
It was thought that this measure might be reflective of teachers* overall 
management ability. There were no differences between the two groups for 
either the average time the teacher was out of the group when she had" to 
leave, or the average number of times per observation that the teacher left 
the group (4036, 4037). 

There were significant differences between the treatment and control 
teachers for the number of groups seen during a morning (4069; £ « «07, 
means 2.95 for control and 3.41 for treatment), and the average group 
size (4070; ^ - .09, means - 7.55 for control and 6.50 for treatment)* 
Tliese results Indicate the treatment teachers were more iikely to see 
fewer ch'ldren In more groups than were the control teachers, on the 
average. Because the treatment said nothing about optimal size of groups, 
this difference cannot be directly related to It. In fact; group assign- 
ments were made before the treatment was Introduced, 

There was a significant difference between the two groups for the 
average number of ictivitles that were given to the students to do either 
vlurin^; a group leison or at their scats after the lesson (5352; «« .03, 
means 1.02 for control and 1.80 for treatment). The treatment teachers 

i) 
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'assigned slightly more activities to their students. (This measure does 

« 

not take into account length or difficulty of activity, but only the number 

* • 

of different activities*) 

These data on time usage suggest that the treatment teachers may have 
been more demanding of thejr students. Because groups were slightly smaller 
on tiie average in treatment classrooms^ and because treatment teachers had 
higher rates of queecioning, this may mean that their students were getting 
exposed to ijiore opportunities for prictice of skills in the group. This, 
combined with slightly more follow-up work^ might mean that trc^atment students 
on the average^ were exposed to more content that demanded their direct 
attention by requiring them to answer questions or complete assignments. 

Part of this could be related to the treatment (more practice by 
individuals in the group) » but other parts cannot (size of group ^ number ' « 
of assignments). ^ ' % ^ 

summary of Time Usage Data . On the average » control and treatment 
, teachers spent the same amount of total time teaching reading in their 
groups. * They also had similar rates of use <^f each of the five lesson 
contexts which were measured. However » treatment teachers had higher 
rates of response opportunities per time, especially nonturn interactions > 
and they al^io had slightly more activities assigned to the students to 
follow up on the reading group lesson • Treatment teachers had smaller 
groups and more groups than control teachers* Some- of these differences 
can be related to the treatment (raore response <*pportuni ties given to 
individuals)^ but other group differences could not btf attributed to the 
treatment (the size of the group, or the mimber of assignments given to 
tlie students'^ . 

■ 0 
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Curriculum Used and Content Covered ^ , 

Although the instructional model was considered/ to be "curriculum-free'% 
inf ormatiow was gathered about the materials' used by the teachers and how 
much was covered during the year in order to determine the relationship of 
this to Achievement, It would be ^cpected^ that there would be few differences 
1>etween the treatment and coAtrol group on the choice of materials used, 
. since schools were assigned randomly to treatment * 

The variables described in this section were computed by reading group 
rather than by teacher, since the curriculum used with each group varied 
even within classrooms. Therefore, these' analyses are based on 72 reading 
groups, 34 in control classrooms and 38 in treatment classrooms* 

There were three basal series adopted by the school district for use 
in first-^grade classes: Economy, Harcourt-Brace , and Houghton-Mifflin. 
Unexpectedly, there were significant differences between the treatment and 
control groups on the principal basal series «sed. The Economy series was 
used significantly more often in treatment reading groups than in control 
reading groups (6002; ^ < ,01, means « .24, ,63). Therefore, more than 
half of the treatment reading groups used Economy, while only about a 
quarter of the control reading groups used this r-»rie?. Although all of 

* * * 

the series Included phonic skills, these were emphasized more heavily in 
the Economy scries. . 

Harcourt-Brace was used more frequently in the control reading groups 
(6003; £ « .01, means = .30, .08), as was Houghton-Mifflin (6004; £^ » .05, 
means = .45, .24) . 

These differences in choice of basals may represent a school effect. 
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^Slnce treatment and •school were confounded » this effect la undesirable^ 
but was unavoidable. 

Other measures of content covered looked at the reading level completed 
by the end of the year and the number of basals covered during the year. 
These comparisons showed differences, although not highly significant, 
between the treatment and control classes.* The treatment group finished 
at a slightly higher reading level (6001; £ • .10, means « 2*50, 2.89, 
where a 3 on the scale represented the primer In the particular series). 
This suggests that these first-grade reading groups were not covering 
as much material on the average as might be expected, since the first reader 
(A on this scale) Vs considered to be the target for the end of f ir»t 
grade. The number of basals completed during the year was also examined. 
This is similar to the variable just reported, except that the former did 
not take entering level into account. The "number of basal? completed" 
reflected tb^ number of books the students completed, regardless of where 
they started. There was also a weak significant difference here between 
the two groups, with the treatment reading groups completing slightly more 
than the control group (.6006; p » .06, means « 4.5, 5.1). Thfs result suggests 
that the treatment teachers wer«- moving their reading groups through the 
basal at a slightly more rapid pace. 

Other measures indicated whether or not the teacher used additioAal 
standard curriculum materials with the students, such as workbooks. There 
were no significant differences between the treatment -and control group for 
systematic usf of basal workbooks (6007; 'tetuuis « »91, .87, indicating that 
almost all rt>.uHnj; f.roups did use the workbooks). However, there were 
dlfferentes favoring the treatment group for use of other supplementary 



materials; worksheets accompanying the basal readers (6008; £« .06, means « 
.06, .21) and spelling workbooks (6009; £- .03, means • .21, .45). There 
were no significant differences for the use of a handwriting workbook (6010; 
' means « .21, .18). There wete significant differences between the groups 
for the use of an English workbook, but these favored the control group 
(6011; 2 " .03, means * .12, .00). , 

There, were no differences in the use of the DISTAR program, with only 
a t&i- control reading groups using this (6012) . There were significant 
differences for the use of SRA materials, with only a few treatment reading 
groups using these (6013; £ - .03, means • .00, .13)* 

When the average size of the reading group was computed with groups ^ 
as the unit of analysis, the difference between the treatment and control 
groups was more significant than that found when reading group size was 
compfea as a class mean. Again, the control group showed larger reading 
groups' on the average (60iA; £ - .01. means - 8.06, 6.40). When average 
class size over the entiie year was examined, there were similar differ- 
ences, with control classes being larger (6019; ^< .01, means • 26.53, ^ 
22.79). 

During %he year, the observers kept track of changes in reading group 
membership, ifid computed varic is Indices of the stability of tie group. 
There were significant differences t>etween .treatment and control classes 
for the average number of cftanges during the year in readin.? groups (6015; 
2 » .02, means « 7.00,* 4.30). Therefore, treatment reading groups had 
fewer additions or changes. It Is not known-^hether this was due to less 
mobility inland out of tho school, t if it was duo to control teachers' 
more frequently rearranging the readlnc; group within the classroom. An 
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overall rating of the stability. of reading group membership was made»^ 
b^sed* on a ratio of changes during the year to the av€ rage grout> size. 
(A 1^ indicated very stable membership and a 5^ Indicated very unstable 
group membership,) This rating of stability of reading group membership 
showed no significant differences between treatment and control classes/ 
with both Having an average rating in the middle of the* scale (6016 1 

* 

means ** 2.59» 2.37). This suggests that the greater number of moves in 
the control classes may have been at deast partially due to their larger 
size. (That Is, there were the same number of moves per pupil «) 

Suamary of group differences on curriculum and content covered * 
Although It was not expected, these analyses yielded s^ral differences 
between- the treajtment and ciontrol classes. Treatment teachers used the 
Economy reading series (with heavier emphasis on phonetics) more often, 
and control teachers were more likely to use Houghton-Mifflin and then 
Harcourt-Bract. with their .reading groups. The treatment teachers covered 
slightly more basal •.aterial during the year, and were at a slightly 
higher reading ]ovel at the end, of the year, although these results were 
not highly signlf Icar.t . There were also some Indications that the treat- 
' ment teachers used additional materials more than the control teachers, 

• * 

such as conuneiVial workshaets* a spelling workbook » and SRA matcrJals* 
The control teachers used the English workbook more,- although not many 
of them used it. Control classes were larger on the average and had large 
reading groups than treatment classes, and there were also moro changes 
among reading group membership In the control classes, although this was 
probably due to their greater size, since a rating scale which controlled 
for group size Indicated no differences between the treatment and control 
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groups on relative stability* 

Other Categories of Academic Teacher^student Xriteraction t 

When describing response opportunities t the observer noted for each 
interaction the type of selection^ the type of question^ the response of 
the child, and type of feedback given • Most selection and feedback variables 
have already been discussed ^ because they directly measured implementation^ 
of some of the principles • However, variables describing types of questions 
and levels of answer were also computed » 

The observer described each interaction in terms of one of nine types 

« 

of questions. As discussed earlier, these could be classified as either 
reading qtSestions, which required -the student to decode words or provide 
information a|jout soiind and letters, and nonreading questions, whi^h asked 
the student to provide information about something that, had been read, or 
an idea that was being discussed* Reading questions were: 

1. repetition - the teacher asked the student simply to repeat 
something she said. 

2. reading choice - the student had to decide between some definite 
alternatives that had to do with decoding words or sounds. 

« 

3. word recognition - the student was to Ipok at a word or letter 
and say Its name. 

A, word attack - the student had to answer a question about a part 
of a word or the sound made by a letter or letters. 
Nonreading questions were: 

5. personal - the student was asked to provide Information about 
an opinion or personal experience. 
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6* choice - the student had to choose between some definite alternatives 
in order to answer a question that did not require him to decode 
^ a word. 

7. product - the student was required to give a factual answer to a 

question that was not a comprehension question « 

,\ • ^ 

8. ^ comprehension ^ the student was' asked to glv& a factual response 

• • 

• based on some material that had just been read« 

9. interpretation the student was asked a "^hy" or **how'* question 
that did not involve decoding a word« 

When the absolute rate per minute of types of questions was examined » 

there were no significant differences between the two groups except for « 

l( < ■ 

the absolute rate of repetiCvSn questions and comprehension questions (11-19). 

Although the rate of repetition quest ionf produced a significant difference 

(11; £ « .10)» the means were so low that i^t was impossible to tell the 

direction (.00 for each group). The treatment group had a higher absolute 

rate of occurrence of comprehension questions than the control group (18; 

p « .10, means « .08 and .15 per minute). However, the proportions of 

response opportunities which were of each type of question showed no 

significant 'differences between t;he two groups ♦ This included variables 

that measured the proportion of response opportunities that were reading 

questions and nonreading questions (666-689). 

J 

Because one important part of the treatment encouraged the teachers 
to use sustaining feedback by askluR simplifying questions, the types of 
questions used for sustaining feodback were compare^. However, there were 
no sip,nlf iorint Jfffcr. nccs in the typos of questions used to correct errors 
(653-650) » 
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These results Indicate that the treatment had very; little effect on 
the general types of questions asked by the two groups. 

The treatm^t 4id not make any direct suggestioni about level of diffiv 
culty or error rate» except to suggest that 8implet*'^eaey-to4answer questions 
should follow initial mistakes. However, the overall error rates were signi- 
ficantly different for the two groups. 

When the absolute rate per minute of correct , incorrect , don^t know , 
and no response answers were examined (20'-23), there were no significant 
differences except for the occurrence of don*t know responses (22; £ » .07, 
means * .01 and .02 per minute). Although this was a statistically signi- 
flcant difference > the means do not indicate a meaningful difference between 
the two group^^n rate of occurrence. 

The proportion of all response opportunities for total interactions 
which involveck correct answers was significantly different for the two groups 
(690; 2 » .04, means .66 and .73). 

Likewise, the proportion of total response opportunities that were 
incorrect answers was significantly different for the two groups (693; 

" • 

£ » .04, means « .27 and .21). 

There were no differences between th'e two groups for the proportion 
of total response opportunities that included don*t know answers (696; 
means » .01 and .02) . 

There was a significant difference between the two groups for the 
proportion ok response opportunities which Included no response answers 
(698; £ « .06, ih^ns « .14 and .10). 

However, whon all typos of answers were examined separately for non^ 
turn interactions, there were no significant differences (691, 694, 697, 699) 
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There were no significant differences between the groups in the number 
of mistakes made during oral reading turns that led to interactions with 
the teacher, although there was a near-significant trend for the control 
teachers to have slightly more errors (701; means « .79 and ,60 mistakes 
per reading turn)*. 

* * 

There was also a near-significant trend for differences -tn the proporr^ 
tions of reading turns th^t were completely correct C702j means • *60 and 
.68). 

These two trends suggest that the treatment teachers^ Students made 

fewer mistakes in oral reading turns. This probably^ contributed to the 

significant differences reported for the proportion of total R^O^^s which 

included correct or im:orrect answers (690^ 693) , since there were no 

differences between the groups for the level of answer in nonturn inter- 

♦ # 

actions* 

Variables that represented combinations of types of questions ahd 
types of answers wore examined to see if teachers in the two groups were 
differentially successful with different types of questions # 

The proportion of total reading questions which led to correct answers 
was significantly different (952'. £ » .05, means .62 and .70). However, 
when, broken into turn and nonturn roadin}* questions, there were.no differ- 
ences between the two groups (953, 954). There also were no significant* 
differences for the -proportion of nonreadlng questions that lead to correct 

» 

answers (956)* The only other significant finding for this type of variable 
was for the proportion of total word recognition questions that were correct 
(708; p - •02» means « .50 and •62) • When brokon into word rer gnition 
questions occurring during turn and nonturn interact ions^ there were no 
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Significant diffjerences (709, 710). Differences for other types of questions 

i 

also were not significant (706-722). 

To determine whether the treatment teachers* higher rate of correct 

« * 

answers was a reflection of their higher use of sustaining feedback, the 

» 

proportion of initial ^selections which led to correct answers was examined. 
These variables represent an error rate for questions asked to « student at 
the beginning of a sequence of interactions, and therefore vould not include 
any correct answers resulting from sustaining feedback with simpler questions 

For each of the five types of initial selection Cordered, preselect, 
nonvolunteer, volunteer, and call out), the treatment teachers had a slightly 
higher rate of correct answers (6A0-64A)* However, this was significant 
only for nonvolunteer selections (6A2; ^» .05, means « ^66 and J2 of 
such selections leading to correct answers).* ^ 

These data suggest that the treatment teachers, on the average, had 
a relatively higher rate of correct answers, and that this cannot be attri- 
buted to their greater use of suitjaining feedback. The differences between 
the groups were not extreme, however. Both groups had more correct than 
incorrect answers. For example, when all Interactions were considered, 
the control teachers averaged 66% correct answers, while the treatment 
teachers averaged 73%. 

Two other types of feedback were observed and coded that did not relate 
directly to any of tne treatment principles but might have had indirect 
relationships. These two were proce ss feedback and new question feedback, 
m procesr feedback, the teacher gave a brief discussion of the process 
used to arrive at a correct answer, or an explanation as to why an answer 
was wrong. A nf.w <iuest ion was the type of feedback noted when the student 
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was allowed to continue a sequence o£ interactions with the teacher, but 
about a brand new question. This meant that the previous question had been 

* 4 

answered, either by the student or by the teacher. It is to be distinguished 
from sustaining feedback following Errors, in which the purpose is to address 
the original question. ^ ^ 

* When process feedback was examined, there were no significant differ- 
ences between the two groups for the absolute rate of occurrence (26) the 
proportion of correct answers receiving profeess feedback (728, 729, 783, 
784, 866, 867. 912, 913) or the proportion of incorrect answers receiving 
process feedback (797, 798, 882, 883, 918, 919), 

There also were no significant differences between the two groups for 
the absolute rate of new question feedback used (33) or the proportion of 
interactions which included new questions (743, 745, 788-790, 856, 871-873, 
916, 917. 811r.813, 860, 896-898, 928, 929, 841-843). Neither of these 
types of feedback was discussed in the instructional model, so it was 
not surprising that there were no significant differences between the two 
groups , 

Other variables were computed to describe th? use of a new question 
folJowlnp, terminal feedback* because it w6s felt that teachers who might 
otherwise use sustaining feedback to follow errors, but who occasionally 
held to use terminal feedback, would be more likely to extend a child 
response opportunity by asking a related new question^ However, there 
were no differences between the two groups for use of a new <iue s t Ion with 
terminal feedback (957^959) • 

Sumhirtf of n*sultr: of f7ro»/) d i ffo t oncry; Hyr oi;h<^r r^^^>7VVi^?f^ o pi^rtunitij 
ca t en or its. Other categories describing response opportunities were examined 

0 
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fo.r differences between the treatmei^ and control groups in types of 
questions asked, rate of correct at/swers, and use of other types of feed- 
back. Since none of these were e^hasized in the instructional model, 
no differences were expected. Several types of questions were examined 

for absolute aad> relative frequency, but there were no significant 

> / 

differences between the two g^bups. However, there were differences in 
relative error rate. Althou;^ all teachers usually asked questions that 

led to correct answers, the treatment teachers had a higher rate of correct 

/ 

answers, and fewer failures to respond. Tliere were no differences between 
the two groups in their ,Ajse of two other types of feedback: process fecd-r 
back (an explanation of how to find the answer) or new question feedback 
(a new question is asked of the same child) , 



Behavior Contacts 

The last set of variables to be presented describe the types of be- 
havloral corrections given by teachers to students who misbehaved while 
a group was betng conducted. There was no significant dlfferenc^ between 
the two groups for the proportion of all contacts that were behavioral 
contacts (J 031; means * .18 and .13). 

The typos of wlsbehaviors that were corrected were recorded for each 
behavioral Interaction. There were no significant differences for the 
absolute rate of occurrence of any type of misbehavior (413-A2A), and 
only one significant difference in relative rates (1002-1009), dealing, 
with the proportion of behavior (Contacts that were for possession of 
contrabami (1009). These wer^- o.n rert imis that resulted when students 
had sotnothlnn in the rendinp, r.ronp with them that was not allowed, such 
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as a rubber band or toy » .08 » means ** .02 and vOl). Although this is 
statistically significant, the means indicate that the actual difference 
was very small. 

There also were no differences between the two groups for the propor- 
tion of behavioral contacts that wore nonintc?ractlve and nondisruptlve 
(1012; means • .73 and .67) or interactive, potentially disruptive, and 
therefore more serious (1011 j means ^ ^27 and *32). These means indicate 
that both groups of teachers used most of their corrections ^pr relatively 
minor misbehavior » although both also had some problems with potentially 
disruptive misbehaviors • 

Each behavioral contact was described in terms oi the teacher reaction 
to the misbehavior* There were no significant group differences for any 
type of teacher reaction (1015ri018, 1025-1028). 

Behavy>ral contacts were classified as being in-group (the teacher 
inl tinted ^some correction with a student in the reading group at that time) 
or out'^of ^group (either a student Interrupted thr teacher or the teacher 
Interrupted the group lesson to cprfoci someont? at his seat). Tliere were 
no differtuices between the two groups ot teachers for the proportion of 
all corrections which were In-group rath<*r than out --uf-group (1040; means » 
.50 and .A7)» There was a significant differonce it\ i\ut prop<>rtion of all 
contacts (response opportunities plus l>oh.ivii>ral o<)utaits) that wore In- 
group corrections (1^077; £ « .10, means .09 and .06). 

There were no differences in the proportitm of all tout nets whidi 

were out-^of- group contacts (1078; means J)9 an<l .07) • There was a 

significant diffeteme for the propt^rt ion of all t eailu^r- ini t iated eontarts 

(thh> in< luded response opportunities^ in-group correct ivi» contacts^ and 

> 
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out-of-group" contacts initiated by the teacher) that were teacherrlnitiated 
out-of-group contacts (1079; £ - .07, me^ns • .06 and .04). 

. These data suggest that the control teachers may have had slightly 
more behavior problems while teaching their reading groups than the treat- 
ment teachers, although the differences are small. It Is tempting to 
attribute this to the differences in the teachers* seating themselves 
so as to Utonitor the group and the class more carefully, and the emphasis 
in the treatment as a whole on teacher control of the lesson. However, 
this interpretation cannot be advanced until there are further analyses 
relating classroom processes to one another. 

Variables were created to indicate the length of most of the out-of^ 
group contacts. When only child^iuitiated out-of-rgroup contacts were 
cotisidered, there were no significant differences between the groups for 
the proportion that were brief in duration rather than long (1041). The 
same is true for only teacherrlnitiated out-of-group contacts (1042)^ 
There was a significant difference between the two groups in the proporr 
tlott out-of-group contacts that were child-initiated rather than teacher- 
initiated (1043; £ = .02, means » ,fl and .50). These data suggest that 
control teachers interrupted their own reading groups more than outside 
students did. 

There were no significant: differences between the two groups in the 
ways that teachers dealt with child-initiated out-of-group interruptions, 
or the ways they contacted students who were out of the group (1045-1076). 

Overall, the data for behavioral corrections suggest that the control 
teachers nuiy have spent slightly more time ami attention on control problems, 
although this conclusion is based primarily on results significant only 
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at the .10 levels 

Summary of group differences on behavior contacts* The control 
teachers had slightly i&cre behavior contacts tKan did the treatment teachers. 
They were more likely than the treatmen^t teaches to Interrupt their Instruc* 
tlon to deal with students out of the grpup who were doing Independent work. 
However, there were no differences between the two' groups for the types of 
misbehaviors that occurred or the teacher reaction to" them. / 

Discussion 

Many of the behaviors suggested by the Instructional model were Imple- 
mented by the tre<^tment teachers at a significantly higher rate than that 
of the control teachers. Some of the principles were not Implosented at 
all by the treatment group, and some of them were already being used by 
the control group to the same extent as the treatment group* 

The principles that showed the strongest treatment effect on teacher 
behaviors dealt with discrete, easily described behaviors that were, p rob- 
ably already in the teachers' general repertoires of techniques (e.g», maxi- 
mizing use of ordered selection and minimizing use of volunteers and call 
outs; maximizing appropriate use of sustaining feedback and minimizing 
use of asking another student for the answer)* Although teachers might 
not have used thuse techniques extensively before the treatment, the descrip-* 
tion of the required behaviors was apparently understood* The teachers 
could easily analyze their own behaviors in these terms and monitor their 
usu* They were also apparently convinced by the rationales for their 
Inclusion in the treatment* Thc^se were behaviors suggested by earlier 
research In similar classroom settings^ and so it is reasonable to assume 
that the teachers recognize their potential value* 

« 

-116- 



On the other hand, behaviors that ^showed no treatment effect and were 
not highly Implemented by either group were less specific and possibly novel 
to the teachers (e.g.. use of a model, breaking up the group; use of a signal 
before lessons). The description and rationale for them was not sufficient* 
to cause implementa^on^ It cannot bfe determined from. the data here if. the 
failure to implement was due to lack of specificity, novelty, lack of suf- 
ficient rationale, or.lnappropriateness for the setting, 

« 

Other behaviors were used to some extent by the control group, and the 
treatment did not Increase the level of use, by the treatment teachers • 
Examples of such behaviors were using a signal^ to start the transition 
and sitting in position to be able to monitor the entire class. Lack of 
significant differences for. these variables might indicate that most teachers 
recognize the efficacy of the principles and are already Implementing them 

regularly.. ^ , 

Even when a treatment effect was found, it was not an "all or nothing" 
phenomenon. That is» the treatment teachers never used a suggested technique 
all of thi^^tlme, and the control teachers always used it some of the time. 
It Is Important to recognize this in building realistic treatment programs 

« 

which acknowledge that teachers must use their own judgment about when the 

situation warrants a particular behavior. For example, sj«evimes a strong 

treatment effect was found only for interactions occurring outside of 

reading turns, where the pace Is slower and the teacher *8 options for questions 

and feedback are greater. There are probably many other important types 

of contextual influences to consider in studying such classroom processes, 

especially when trying to brin^j about change in those processes. Some of 

•i ♦ 
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these contextual Influences are discussed In Anderson, Morgan, Evertson, 
♦ and Brophy (Note 5) . • » 

In summary » the treatment was generally successful In Influencl^ 
change In the treatment teachers* behaviors » but the results deiiK)nstrlated 
that not all components of the treatment were equally successful « An 
analysis of the^ different results for these parts suggests that future 
treatment models* should consldet^^jthe specificity and familiarity of the 
behaviors, their appropriateness for particular contexts, and the role of 
teacher judgment in implementing them. 

These analyses also revealed that the treatment teaphers differed 
from the control teachers in ways that could not be littributed directly 
to the treatment* In trying to account for the treatment effect on overall 
achievement I these differences must be considered « * The possibility exists 
that the treatments teachers were different from the control teachers before 
the study began^ despite random assignment of schools to groups ^ and there 
is also a possibility of a Hawthorne or expectancy effect > which influenced 
the treatment teachers to work harder and do a better job simply because 
they knew they were an experimental group and were expected to do better 4 
These possibilities are discussed further •in Chapter 5, where the group 

ft; 

differences are compared to the regression data to see how closely they 
match, \w order to determine whether the achievement differences were due 
to the treatment* 
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Chapter A; Results^ of Regression Analyses 
- This chapter presents relationships' between the classroom process 
variables and student achievement. In all analyses (except for one set» . 
which Is discussed In the text) , the class mean scores were used to represent » 
the average readiness level of the students at the beginning of the year, 
the average achievement of the students on two tests given at the end of 
the year, and the average score for that class or teachev on each process 
variable. Therefore, the N for all analyses Cunless Indicated otherwise) 

was 20. ' ' 

The analyses used to determine the strength and direction of process- 
product relationships yere a series of comparisons of ^Inear models. This 
approach to regression analysis Is described In Ward and Jennings (1973) , 
and thj computer programs used to create the particular models used, for this . 
study were developed by Veldman and Linsley (Note 6) . The models used and the 
hypotheses tested In each comparison are described below, and ar. explana- 
tlon Is given of the tables, which are reduced from the computer output. 

Data Analysis 

Two sets of linear regression equations were compared for each of the 
potentially predictive teacher or classroom behavior variables. One set 
provides the degree of simple relationship to gain and also the degree of 
interaction with initial ability. The second set of equations identifies 
the extent and nature of any second-dcgree curvilinear (quadratic) rela- 
tlonshlps between the variables. These aitalyscs are Included in the tables 
whenever there is an interpVetable curvilinear effect. 
Linear Rc l a t i o nsh lj>s 

The three regression equations used In this set are shown below. As 



« 
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indicated, each producea a squared multiple correlation coefficient, and 
c<Hiqpari80Q8 of these yield tw> F-ratios and associated chance probability 
values, 

2 

Ach • TRD + CB + (CB} (TRD) + • • 

2 

Ach « TRD + CB + R2 
Ach - TRD +*Ej R^ 
, ( rJ - R^ ) ( N - A ) 

P, « i i 5 df»l, (N-4) . 

^ ( 1 ^ ) 

( R? - r2 ) ('N - 3 ) 
F - --^ 2 df - 1, ( N « 3 ) 

^ ( 1 - R^ ) 

In these equations **Ach** is the Total Reading or Word Analysis 

• * « 

achievement score from the MAT given at the end of the school year, **TRD** 

is the Metropolitan readiness measure, **CB** is the particular classroom 

behavior variable being assessed, and *'£** represents errors of prediction. 

Each equation is solved for a set of weights which minimijse the E values, 

2 

thus maximizing R , which is an index of the amount of criterion variance 

associated with the predictor variables in the equation. 

2 

.Hie first equation R must equal or exceed that of the second, wh^h 
must in turn equal or exceed that of the third, because- each equation con- 
tains successively less information.^ The product variable in the first 
(Kjuatlon represents the interaction of Initial ability and teacher or class 
room beliavior, and the first F--test therefore assesses whether the relation- 
ship Is the same at all levels of entering readiness, Tlie second model com~ 
parison forces the relationship to be comnon at all ability levels, and then 



ask8 Whether the relationship Is signlflcant^ly greater; than sero. Because 
the readiness score appears in all eqiiations^ it is said to be **statistical- 

• ♦ 

ly controlled.** For instance » the second comparison -asks Whether achievement 
is predictable ^rom the teacher behavior beyond What is predictable from the 
readiness score. Itt other lai^uage, we are asking whether classes that are 
exposed to different levels of the teacher or classroom behavior » but Which 
are identical in initial readine ^ dif fe y^*i^~V^lr expected (predicted) 
achievement at the end of the year. 

In the event that the interaction is found to be statistically signifi- 
cant (2.1 .10), expected values for the achievement test erp calculated for 
particular combinations of readiness level and classroom behavior in order 
to explicate the nature of the interaction.. Four combinations' are sufficient: 
a) low TRD with low CB; b) .low TRD with high CB; c) high TRD with low CB; 
d) high TRD with high CB where "high*' and "low" are plus and minus 1 slgma 

♦ * » 

from the mean of the variable concerned. To facilitate comparisons across 

• « 

classroom behavior variables, these values are scaled 'as z scores (mean « 0, 
SD » 1). In the example bel^w, we tfee that the behavior is positively related 
to gain, but that it is more strongly related among classes initially low 
in readiness than among-those initially high. 

Hl^h 

♦ 

Achievement 
Score 

Low 

Low High 
Classroom Behavior 




The second test of the series, which forces the Implicit regression 
lines to be parallel » may or may not be significant » ladependent of the 

♦ 

interaction effect. If both are s'ignif leant » we can make a general statement' 

4 

9 

about the classroom behavior's effect but with a qualificatl<m recognising 
its interaction with initial readiness* 

* * 

In the event that only the second test is si^lf leant » we can 4etermine 
the direction of the effect of the classtoom bj^havior simply by examining 

■ « 

the sign of the CB beta wej.ght in the second equation. 
Curvilinear Relationships 

The previous set of models is sensitive only to the linear aspects of 
the orelatlonshlp between classroom behavior and gain. To determine whether 
regression lines which are allowed to curve will better fit the actual data 
points, another set of regression models was employed. 

Ach - TRD + CB + (CAT) (TRD) + (CB)^ + (TRD) (CB)^ + Ej rJ 

Ach - TRD + CB -I- (CAT) (TRD) + - * R^ 

( rJ - R? ) ( N - 6 ) 
F - ' 5 df • 2, ( N - 6 ) 

2( 1 - Rp 

Tlie second of these equations Is, of course, the first of the previous 
set* By adding the last two* terms ^ squared CB scores and their products 
with the readiness scores pemit the lines not only to bend once» but 

to bend differently at different levels of the readiness teste 

If thvt F test is significant » we conclude that allowing the regression 
lines to bend does Indeed afford a better fit to the data. To obtain a 
graphic reflection of such an effect, five expected values are computed for 
the low readiness level and five also for the high readiness leVel. Class* 
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room behavior values for* the mean, plus and minus 1/2 sigma^ and plus* and 
minus 1 signs are .plugged into the equation with a high ci* low readiness 
SCO/re. Vae resulting set of ten values can be used to produce a plot such 
as this example r 



High 



Achievement 
Post test 



Low 




Low 



Classroom 
Behavior 



High 
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In this example » the suggestion would be that in the midrange of the 
classroom behavior, it has a depressing effect on the performance of low 
readiness classes and an enhancing effect on those of high readiness classes, 
but when the classroom behavior is relatively high or low, readiness is not 
relevant. There is also the suggestion here, reflected by the dotted line, 
that for average ability classes, the classroom behavior is not associated 
with achievement at all. 

Each variable describing cl^sroom processes was analyzed in the manner 
shovm below for two achievement Scores: Total Reading (which was the sum of 
the Word Knowledge and Reading subtests) and the Word Analysis subtest. The 
tables are reproduced as they come from the computer printout (Veldman and 
Linslcy, Note 6). The followlns; outnut will be used is .m examole to aid the 
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Figure 1: Escamplo of Tables Describing the Results of Regression Analyses 



Variable label 
(ClassrKxm Behavior ^ CB) 



Criterion of interest * 
(TlR ^ Total Reading scores f 
f/DA » Word Analysis score) 

2 

Difference in R between 
models 1 S 2 (test for * 
interaction) « - 



Difference in R^ 
models 2 & 3. — 



between 



Beta weight represents 
change in criterion 
(z scaled) per ^ one 
Sigma increase in class^ 
room behavior. Sign 
indicates direction ^of 
change. If interaction 
is significant, best pre^ 
diction is obtaHhed from 
m:tdel 11 — ^ — — 
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aignificant linear 
relationship between 
the cl^sroom behavior 
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teadec In understanding the data tables. \^ 

' In the text, the results are accompanied by sooe statistical informs- 
tlon. When results are significant, the £ level is given and the range of 
plus and minus 1 sigma is renorted for the classroom behavior variable. 
Since two series jof tests were run for each variable (one for each achieve- 
oient score), both are reported at the sane tine to determine the strength 
of relationship. Since the N was low (20 classes for most analyses), and 
since patterns in the results were considered more Important than the abso- 
lute probability level of any sing^.e test, a value of £ <. .10 was selected 
fdr considering the results to be significant. Since two criteria were- 
available, the following rule was used to determine inclusion of results 
as significant. Results are reported as slgnlficcnt if the classroom 
behavior variable" was related to one' of the test scores with an associated 
£ level of .05 or less, or if it was related to both teft scores at a level 
of .10 or less. Therefore, results in which the variable was weakly related 
to one criteria (i.e., .05 < £ < .10), but not related to the other (£ > .1 
were^not reported as significant. 

Variable numbers are given for all results so that the tables may be 
referenced (see .below for table numbers including variables of interest) . 
When results are significant, information is included In parentheses to give 
the variable number, the £ levels for the two tests, with Total Beading first 
then Word Analysis, and the range of the classroom behavior that fell within 
plus and minus 1 sigma from the mean. For example: 

(4035; £ < .01, £« .05; range « 21.24 to 31.84) 
would indicate that variable 4035 (which was the average time that reading 
groups mot) was significantly related to the Total Reading score and the 
Word Analysis score, and that most groups met from 21 to 32 minutes on the 
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average. The discussion of this result in the text defines thid' relation- 
ship as being positive. The beta weight for the slope may be found in the 
tables « 

Since they we^e analyzed separately, the results for the Total ^Reading 
scores and Word Analysis scotes .appear in different tables. The tables are 
also divided according to the type of data describing classroom processes 
in the same way that was done for the gi^oup comparison data. The following 
is a guide to finding variables in Tables 10 through 18 i » 



Variable 


Describing 


Test Score Used 
as Criterion 


Located 
in Table 


4026-r5369 


Reading group measures 


Total Reading 


13 


1-431 


Rate variables 


Total Reading 


14 * 


601-1079 


Proportion variables 


Total Reading 


15 


4026-5369 


Reading group measures 


Word Analysis 


16 


1-431 


. Rate variables 


Word Analysis 


17 


601-1079 


Proportion variables 


Word Analysis 


18 



Throughout the text, reference is made to "low ability" or "low readi- 
ness" classes, or to "high ability" or 'lilgh readiness" classes. These refer 
to classes that were one sigma below or above the mean respectively on class 
mean readiness i as measured by the Metropolitan Readiness test. Whenever 
interactions were detected such that the relationship with achievement depend 
cd on both the level of the classroom behavior and the entering readiness 
score, the computer program plotted the relationships for such classes to 
illustrate the different slopes. For purposes of brevity, the text will 
refer to "low" and "high" classes, but the reader should understand that 

« 

those references are to the statistical extremes, rather than to any abso- 
lute level of ability or readiness. 
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Results 

Getting and Maintaining Students* Attention (Principles 16 7) 

Use of an attention getter and its effectiveness . There were no slgnl* 
f leant relationships for the proportion of times that an attention getter 
was used to begin a transition (5312) or to begin a lesson (5321). 

The variables describing the kinds of attention getters used in transi- 
tions and at the beginning of the lesson also showed no significant rela- 
tionships for either test score (5313 » 5315, 5316, 5318, 5319). 

Although there were no significant findings for the use of signals to 
begin transitions, there were important relationships with achievement for 
the smoothness of transitions. There was a significant negative relation- 
ship for the proportion of total observed time that was spent in transition 
(4062: £*8 - »03, < .01, range - .07 to .15); therefore, the higher the 
proportion of total time spent in transition, the lower the achievement. 
It is likely that this variable reflects the teachers* overall management 
abilities: the more effective teachers had smoother and shorter transitions 

Other variables describing time spent in transition were the average 
time taken for each of three components of the transition: the time to 
the group for students, the time to the group for the teacher » and the 
time to the lesson once the group was together. For the first two variables 
there were no significant relationships (A026, 4027). However, the average 
time taken for the lesson to begin once the students and teacher were in 
the group showed significant negative linear relationships for both tests 
(4028; £'s « .10, .03, range « .59 to 1 .8 f> minut os) . Tht« variable probably 
reflects the teacher*s maniigemcnt ability, because the time in this cotnpooen 
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was spent organizing materials and getting students' attention* A well- 
organized teacher would have the materials ready, and could get student 

attention quickly* * 
f These three components were also examined as proportions of the total 

transition time. There were no significant- relationships for any of them 
for the Total Reading score, but the proportion of transition time that 
was tlme-to^group for the teacher showed a significant interaction in the 
Word Analysis score data (4060; £» .03, range « .OA to .33). Relationships 
were positive for high and negative for. low classes. The negative slope 
for lower ability classes makes intuitive sense, in that teachers who were 
with their stu4ent8 sooner were decreasing "dead" time in the group when 
the students were left without* direction. However, the positive findings 
for higher ability classes are puzzling. In the absence of significant 
results for the Totsil Reading data, this finding will not be Interpreted 
at this point. 

One of the moasures of the effectiveness of attention getters during 
transitions was a rating on* a S^pclnt scale of the percent of children 
•paying attention tc signals when they were given. , This average rating 
showed sif.nificant positive linear relationships with both tests (5303; 
p's = .01, .03, range - 3.05 to 3.67 on a 5-point scale). Most teachers 
had 60 to 80 percent of their students attending to the transition signals, 
but those who got higher attention were produciuR higher achievement. 
Ar.ala, this result Is probably a refle<^tlon of better management by the 
more effe».tfve teachers. However, there were no significant relationships 
for the average rating of the percent of children attending to signals 
j>iven at the beginning of the lesson (5304). Prelesson signals were not 



^7 
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used very often, and when th^y were and Qould be rated, the range vaa ^ 
fairly restricted. Therefore, the lack of significance fpr this variable 
probably reflects its poor distribution and low frequency of occurrence. 

Another measure taken to indicate effectiveness of signals was the 
number of times teachers repeated signals to start the tr^sition or to 
get attention in the group (40A1. 4043). Both variables had restricted 
ranges and there were no significant findings. 

Another indication of effectiveness of signals was the average number 
of individual corrections delivered by the teacher during the transition 
or at the beginning of thfe lesson. There were no significant results for 
the average number of corrections during transitions f4042) , but 'there was 
a significant negative linear relationship for the average! number of indivi- 
dual corrections given before starting the lesson (4044; £*s • .05, .01, 
range • .17 to .75). The more times the teacher corrected individuals 
before beginning the lesson, the lower the achievement for the class. This 
variable probably also reflects the teacher's overall management ability. 

Seating the group . The teacher's adherence to Principle 2 (arranging . 
the group) was measured by two ratings. The approprlatent^ss of teacher 
seating was defined as the number of students who could be seen easily by 
the- teacher (a rating of 5 represented 100%). Likewise, appropriate child 
seating wa*. defined as the number of other students who could be seen easily 
by the children In the reading group (Ojicre 5 represented OX). There was 
a significant positive linear relationship for the average rating of teacher 
seating (5101; « .01, .03, range « 2.72 to 4.21). Teachers who arranged 
thoraselver. so as to see most of the out -of -group students were also those 
who produced greater achievement. This variable probably also reflects the 
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teacher ^8 overall management ability* in that monitoring la an important 
part 6f management. There vere'po significant findings for the average 

♦ 

rating for child seating ^5302) . 

Summary of results for Principles 1 and 2 » The first two* principles • 
in the model emphasized the-4«portance of getting and maintaining the atten- 
t^n of the students. Some specific suggestions were made In the model for 

achieving this: using clear signals to call for transitions an^ to get 

♦ 

attention to begin a lesson, and arranging the group so as to make monitoring 
of the entire classroom easier for the teacher and dist: ictions less likely 
for the students in the group. Several variables were created to measure 
both th^ implementation of these specific suggestions and their immediate 
effects* 

* 

The results suggested that the more effective teachers (In terms of 
achievement gains) had better control at the beginning of the lesson, as 
reflected in several short-term outcomes such as time measures and ratings 
of attention. However, the only specific behavior included in t »e instruc- 
tional model that was related to achievement and to these m^nag< ont skills 
was the teacher seating herself to monitor the out-of -group students. Use. 
of slf,^lals (as suggested by the model) did not relate to' gain, but there 
was restricted variance here. (Most teachers in both treatment and control 
groups used signaU* for transitions, and very few teachers used them to 
Start lessons*) 

However, measures indicating the overall M^JJsSJXyy^S3^ transitions 
and beginning lessons showed significant positive relationships with gain 
(e.g.» timt- spent in transitions, rating of student attention, less need 
for corrections of students once they were in the group). A measure of 

' ■ > <> 
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time spent between the arrival of all persons in th^ gKcnp and the beginning 
of the lesson showed negative relationships. This could reflect aithar 
a> lack of teacher preparation and/or more tine spent getting students^ 
attention* 

In general, then, these findings indicate that tfie wore effective 
teachers had better control during transitions and when beginning lesson%« 
This is probably due to overall management skills « 

, • 

Introducing the Lesson and Material to the Students (Principles 3,4,5, S €) 

Using an overview . For each observation, the observer noted whether 
the teacher gave no overview, whether she gave an overview containing only 
mechanical content (i.e., the pages to be covered), or whether she gave an 
overview containing specific instructional content. Proportion variables 
were created to refle.t the number of * observations in whicH the teacher did 
each of these things. The proportion of time in which no overview of 
instructional content was given showed a significant negative linear rela- 
tionship with Total Reading scores (5330; £ • .03, range - .38 to .78). 
However, thi« variable was not significant for the Word Analysis score. 

Several variables described the content of overviews, but none was 
related to achievement. There were no significant relationships for the 
variables describing mechanical overviews vs. specific Instructional over- 
views (5331 and 5332). There were also no slgniflcent findings for any 
of the variables describing motivating statements in overviews (5334-5336). 
The rated enthusiasm of the teacher's voice and of the students also 
showed no relationship with achievement (5305, 5306). Most overviews 
were given ami received in a neutral manner. 

. i) 
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Therefore, the results suggest that ' teachers who failed tio give over~ 

views most o£ the time had 'lower achievenent* but that the actual content 

*" « 

of overviews did not predict achievement* 

Presentation of nevwrds . There were no significant relationships 
for the average number of new words presented in a lesson (5358). There 
also were no significant results for the proportion of group lessons in 
which any new words were given or the average number of new words that were 
given at any one time (5368, 5369). 

* 

There also were no significant relationships for the proportion of 
new words given at the beginning, rather than during the lesson (5359), or 
for the proportion of new words j^iven by the teacher rather than asked of 
a child (5360). 

However, there were significant findings for the use of clues when 
new wordft were presented. There was a positive linear relationship for 
both tests for the proportion of new words given with phonetic clues 
(5361; £*s » .02, .05. range « .17 to .71). there were no significant 
findings for the proporti/a of new words given with context clues or with 
both phonetic and context clues (5362. 5363). However, there were weak 
negative findings for the proportion of new words presented with no clues 
at all (5364; p*s » .06, .09. range « .13 to .66).* This suggests that 
teachers who frequently present©^ new words without any clues at all had 
lower achievement. ^ 

Re pc 1 1 1 i on o f ne w wcnrds^* .When new words were presented ♦ the observers 
noted whether or not the- teachers had the students repeat them and how this 
was done whon it occurred* There were no significant findings for the 
proportion of new words which were repeated by students (5365) • There 
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were no clear-cut findings for the proportion* of nw norde repeated chorally 
instead of individually, but a weak negative relationship wai suggested 
(5366). 

There were no significant findings for the proportion of new words 

# 

which werfe repeated by all of the children rather than by sone (5367) . 

I In summary of the data describing presentation of *new words, no variables 
related to the treatment demonstrated .relationships with achievement. However 
using phonetic clues when j)re8enting new. words was associated. with gAln. 

Demonstrations and -eScplanations . There were no significant findings * 
for the proportion of activities Introduced by a teacher demonstration 
(5348), or for t|ie proportion ^not requiring a demonstration (5350)* (Most 
activities were introduced by a. teacher demonstration.) 

There also were no significant findings for the proportion^ of demonstra- 
tions that had to be repeated because the students did not understand (5351). 
Other variables measuring effectiveness were 5-point rating scales of the 
•♦sufficiency** of vhe demonstration and the percent of students in the group 
who apparently comprehended it (as judged by their performance afterwords) . 
There were no signlficanti findings for either of ^thesfe variables (53lD>and 
5311). Tht> ranges were restricted, 'however, which suggests that the ratings 
may not have been sensitive to variation^ in quality of demonstration. 

The observ-ers noted for each demonstration If and how the teacher 
checked the students* comprehension. There were five options for this. 
The proportion of demonstrations in which student c ompre hension was che cked 
b y having students repeat the instructions showed no relationshlpsswlth 
achievement (5354). However, the proportion of demonstrations In which 
studett t comprehension was checked by having the students actually demon- 



strate the proccduy^s before using them allowed significant curvilinear 
relationships (5355; £*s < .01, < .01, range • .06 to .29). For each test 
score, these curves showed inverted U«>8haped relationships for ^igh classes » 
but shallow positive slopes for low classes. Perhaps this technique is 
usually appropriate for lower level students who can show their understanding 
more easily than they can explain it, but it may be inefficient for higher 
level students it used too much of the time. 

The proportion of demonstrations in which student comprehension was 
checked by starting the lesson in the Ztotxp so that the teacher could observe 

♦ 

t le students yhile they worked showed no significant relationships (5356). 
Also, the proportion of times that students were sent to their seats after 

* * 

a demonstration without any checks for comprehension showed no relationships 

« 

(5357). The rangQ. of this variable was. 19 to .47, indicating that It 
occurred frequently in some classes, but rarely in others* 

Swmar^ of results for variables for Principles 3,4,5, s 6 , This group 
of principles made suggestions about presenting new .material to students, 
and was based on the rationale that it is easier for students to rieceive 
and process Information when it Is broken down for them Into small chunks. 
The specific suggestions made were: use overviews at the beginning of the 
lesson, present new words before they are encountered In riding, have students 
practice m w words when presented, and provide carefully sequenced demon- 
strations of activities which include checking for comprehension. 

4 

Very few of the suggested techniques showed significant relationships 

/ 

with achi«*vement, although some variables which were measured incidentally 
did show relationships. For Total Reading scores, there was a significant 
negative relationship for the absence of any overview, but this was not 
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found for the Word Analysis score, end other variables describing the quality 
or content of the overview shoved no relationships. These data suggest that 
the use of some kind of Introductory statement about the lesson may be bene«- 
flclal, but no conclusions can be Inferred about what that overview should 
Include « 

There were no significant relationships'* found for the provision of new 
words at the beginning of lessons or for the repetition of new words. However^ 
two variables measuring the ways In which these principles were Implemented 
did yield significant results. There were positive relationships for the 
use of phonetic clues with presentation of new words, and there were weak 
negative relationships for the absence of any clues at all. These data 
augsest that presentation of ne. «*,rdB .hould Includ. infor».tlori about the • 
phonics rules involved • 

There were no significant relationships for the use of demonstrations , 
or their rated effectiveness. There were no findings for any of the variables 
'measuring the ways teachers checked for comprehension except for the propor- 
tion of times the teacher asked the students to demonstrate the procedures 
back to her. This variable showed an inverted Ur^haped telationship for 
higher-ability. Students, but there was more of a straight positive slope 
for lower ability classes. This suggests that students, especially tnose 
of lower ability, are best checked by having them actually show that they 
know how to do something, rather than by depending on th^^m to ask questions 
or assuming that they always understand. 

There were no relationships for the g^roportlon of time the teacher 
failed tfo check students* comprehension of a demonstration before releasing 
them to do some activity. 

' i I 
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Calling on Individual Students in the Groap (Principles 7,8,9,10,11, S 12) 

Working vlth one child at a tin^ and giving feedback . The rate of total 
response opportunities (R.O.'s^ given per minute showed significant positive 
relationships with achievement (60j^; J2»*8 * .08, .05, range - 1.61 to 2.45). 
The rate of nonturn response opportunities, per minute showed strong positive 
relationships (602; ^'s • .01,' .01, range • 1.00 to 1.84). There were no 
significant relationships for the nttmber of reading turns per minute or for 
the number of reading turn response opportunities per minute (603, 604). 
These results suggest that the more teacher interactions with individual . 
, students, the higher the achievement. This was especially true of inter- 
actions that were single questions and answers (i.e,, nonturn), rather than 
those occurring within reading turnsi 

There were no significant relationships for the absolute rate per 
minute of failures to give feedback following a student's answer (24). 
Likewise, there were no significant findings for the proportion of total 
or nonturn response opportunities receivlnR no feedback (723, 724). The 
ranges for these two variables were .02 to .15, and .00 to .13, respectively, 
indicating that omiasion of feedback did not occur often. 

However, when examined only for correct answers,* there were weak 
significant positive linear relationships for the proportion of total 
correct answers with no feedback (778; » .09, .07, range « .00 to .15). 
and for the.proport ion of nonturn correct answers receiving no feedback 
(770; p*s = .09, .07, ranjic = .00 to .16). 

The proportion of total it^correct answahrs which received feedback 
was not significant (793), but for nonturn R.O.'s with Incorrect answers, 
this variable did show a significant negative linear relationship within 

t 

♦ 
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a restricted range C794; |^ < •Ol t 2. * •^^^ range ♦OO to ^02)^ 

- These results suggest that there is A weak positive relationship for 
omission of feedback following correct answers, although this did not occur 
often (less than 151 of the time). However^ there were negative relationships 
for no feedback following incorrect answers, although this, was rarei These 
results are reasonable, even though they are in parti.al conflict with the ' 
treatment principles dealing with giving feedback to student responses « 
It is obviously inappropriate to leave an incorrect answer without feedback i 
but a correct answer, especially one that is obviously correct, may not 
require acknowledgement. Within limits, omitting feedback to correct answers 
apparently was an efficient strategy « 

The frequency of group responses was part of the evaluation of this 
principle, TWo types of group responses were noted « Choral responses 
occurred when the teacher indicated that she wanted the group to respond 
in unison. Group p^llTouts were noted when more than one student shouted 
out in response to a question that was not intended for the group. This 
distinction was i^ortant, because there were different results for the 



y' • 

two types of group responses 



There were no significant relationships for the average number ^of 
choral responses per observation (4038), the average number of group call 
outs per observation (4039), or the average number of these combined (4040). 
However, when choral responses and group call outs were examined as rates 
of occurrence per minute, several relationships were demonstrated. There 
were no significant findings for the rate per minute of choral responses 
and group call outs combined (4053). However, the number of choral responses 
per minute showt^d significant negative linear relationships (4051; £*8 - .05, 
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.04, range • .OA to .24). The number of ^r oup call onts per ninute deaon- 

< 

strated significant interactions (4052; ^'s « .05, .04, range « .06 to .34). 
These showed negative slopes for high level classes and positive slopes for 
low level classes. Tftese results are similar to those found by Brophy 
and Evertson (Note 1) with4»igh and low SES classes. In which positive 
relationships with call outs for low SES classes were interpreted as indl- 
cations of student enthusiasm and motivation, hut negative relationships 
within higher SES clas.ses were interpreted as indicating that call buts 
represented control problems in that setting. 

These results suggest that it is probably better for teachers to minimize 
calling for choral responses; but that within some classes, allowing group 
call outs may be desirable some of the time, Howeveju they should not be 
SO prevalent as to take away time from individual response opportunities, ' 
which showed much higher positive relationships, even for lower .ability 
classes. 

Methodg^f s electing students for response opportunities . Five types 
of initial selection were noted with the coding system. Initial selection 
referred to the way In which the teacher chose a student to answer a question 
or read aloud at the beginning of what could be a series of interactions. 
The typrs of initial selection were: 

1. Ordered, The teacher selected the students on the basis of their 
seating position, by moving around the group in a consistent pattern and 
choosing students In turn. 

2. Preselection, The teacher called a student's mme, and then asked 
the question. The selection was not based on the order of seating. 

3. Non volu nteer . The teacher asked a question, and then called on 
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8 Student vho had not volunteered to answer (but not on^hie basis 'of seating 
position). 

^* Volunteer . These were selections in which the teacher asked a 
question, and then called on somebody whose hand was up (but not on the 
basis of seating position) * 

5. Call out * The teacher asked a question, and before she could call 
on someone to answer it, another student called out the answer without 
permission* In order for call out to be coded, the teacher had to respond 
to the content of the answer by acknowledgement or feedback. If the teacher 
ignored the student and called on another child, or corrected the student 
for calling out but did not respond to the content of the answer, the inter- 
action was not coded as a call out selection (i.e., it was not a response 
opportunity) . 

There were no significant findings for the rate data describing types 
of selection (1-7) , bjit several patterns were present in analyses of the 
proportion data. Proportion variables were created that examined the rela- 
tive number of Interactions chosen by each type of selection. As was done 
for most proportion variables, these were fexamined for the separate types 
of Interactions (turn and non^urn) and for total interactions. Response 
opportunities were also broken down into reading and nonreading questions, 
reading questions in nonturn interactions, and personal questions. These 
variables were created to give as precise a picture a9,^pos8lble of the 
influence of type of selection, and to see If this Influence varied accord- 
ing to type of^ interaction or type of question. Kach set of variables Is 
examined below. 

The first set arc those that arc not broken down by type of question* 

* 



but which are distinguished as to turn andsnontum interactions. 

X X * 

The proportion of all initial selections that were ordered wasr positively 

linearly related to achievement (607; 2»8 • .04, .05, range • ,19 to .77). 

This positive finding for the use of ordered turns was also demonsjtrated 

when interactions were analyzed for reading turns (608; £*s • .03, .05, 

range » .23 to .88), and nonturn interactions (609; £*« * •06, .07, range • 

.17 to .7A). , 

The second category, preselection , did not show <llear relationships 
with acnievement. For the proportion of total interactions that were chosen 
by preselections, there was a significant interaction for Total Reading 
scores, although not for Word Analysis scores (610; £*s'- ,02, .13, range 
.00 to .19). The interaction with Total Reading Scores showed a negative 
relationship for high ability classes and a positive slope for low ability 
classes. The same interactive pattern emerged for both test scores for the 
proportion of reading turns selected by preselection .(611; £ < .01, £: • .03, 
range » .00 to .25). Again* the interaction is one in which there is a 
negative slope for higher ability classes and a positive slopf for lower 
ability clf»88es. When .»examined for nonturn .interactions in which preselec- 
tions were used, there were no significant relationships (612). 

The results suggest that preselections are not desirable in higher 
ability classes but may be useful in low ability classes. However, pre- 
selections were not used frequently and so' these results must be interpreted 
in light of the observed ranges: from infrequent to occasional use. Their 
occasional use in lower ability classes may represent careful matching of 
question to rispondont when this was necessary to catch someone > attention* 
(That is, tljc teacher would call the child's name first, and then ask a 
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question.) Greater use might represent teacher sensitivity to student atten- 
tion and efforts to bring students back into the lesson. This is likely 
a gK;(eater probiem with lower ability classes at this grade level, where 
students may not have developed their attentional skills. On the other hand* 
the negative results within higher ability classes might represent too many 
problems with inattention. In groups where students should be expected to* 

* 

control their own attention most of the time. (Further analyses at the 
ability group level within classes may shed more light on the meaning of 
^this interaction.) 

The proportion of total interactions answered by nonvolunteers showed 
a tftgnlficant negative slope (613; £*8 « .02»-.08, range .08 to .3A). 
Use of nonvolunteer selections for reading turns showed a similar pattern 
(614; £ < .01, £ < .01, range « ,05 to .39). However, when examined only 
for selection for nonturi\ interactions, there were no significant relation- 
ships (615). As with other selection variables, stronger relationships 
with achievement were found for reading turns. 

There were no significant relationships for any of the variables 
describing proporcionta of interactions selected by volunteers (616, 617, 
618). These sc^ldom occurred more than 25% of the time. It had been expected 
that extensive reliance on volunteering would be negatively related to 
achievement, due to the more reticent students receiving too little practice. 
Within the observed ranges, however, this was not supported. 

The use of ca^n.93i^ ^ ^yP^ selection was analyzed only for total 
and nonturn Interactions becaust; call outs did not occur, very often for 
reading turns. For each of these, there were s i>;ni f i*aut negative linear 
relationships: for total interactiors (619; ^'s «* .OA, .01, range - .03 
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to .13); and for nonturn Interactions (620; £»8 - .01 , < .01, range -» .02 to 
.21). That is, the higher the relative frequency of call outs, the lower 

♦ 

the achievement.. In the small group setting, .call outs nay represent a 
control problem, with a few students attempting ^ dominate the interactions. 
If this is so, then the negative findings ake senJfV^ Other variables 
describing call outs suggested that this might be less of a problem in lower 
ability classes, but this particular variable showed no interactions. It 
might yield these differences when analyzed at other levels (i.e., ability 
groups within class) where there would be more variation in ability. 

The results described above were n<!it distinguished according to question 
type. In order to determine if different types of selections might be 
appropriate for different types of questions (i.e., reading, nonreading, 
or personal) , several variables were created to describe combinations of^ 
selection and question type (e.g., the proportion of all nonreading questions 
selected by ordered turns). It was expected that questions tapping skills 
should be soKctcd systematically, under careful teacher control, while 
personal questions might be better selected by volunteering, allowing more 
student control of who answered. 

The «arae p.tttern of results was found for these more specific variables 
as was found for those already discussed. There were no reversals of 
«ignifltant findings. Only two types of selection, ordered and call^out, 
tihowta «ir."if it-^nt results for all types of questions examined. All other 
selection tvpes phowed significant relationships only for reading questions. 

Teacher rrt^iH^nnvH ±o yaU puin. Principle 11 suggested that teachers 
tiv t . r. hi tit re <.»ll outs, responding to them with mild remindt-rs that 
tiling out was not acceptable in the clavssroom. However* it was emphasized 



that teachers should be careful not to quench the enthusiasm which led to . 
the call out. The relationship of calling out to achieveaent has been 
discussed in the previous section and this section examined the ways in 
which teachers responded to call outs when they occurred* 

The proportion of call outs that were selected (that is, were accepted 
for their content and responded to) and also corrected by the teacher was 
not significantly related to achievement (1032) . The distribution for this 
variable was positively skewed, with a range of .00 to .10* This sugg49ts 
that most call outs that were accepted were not corrected. 

There also were no significant relationships for the proportion of 
call outs which were corrected but not accepted for their content (1001) . 
The distribution for this variable was slightly negatively skewed, with 
the range being .79 to 1.00. These two variables considered together 
suggest that teachers who 'accepted the content of call outs were not likely 
to correct them, and that if they did correct a call out, they were not 
likely to accept its content. Therefore, there was no extensive test of 
the principle of accepting call outs but also gently reminding students 
that they were not acceptable. 

Three types of corrective responses to call outs were examined: 
man age ment (mild corrt'ctive statements), warning (more severe statements), 
and criticism (most severe, sometimes involving punishment). There were 
no significant relationships for the proportion of corrected call outs 
that Included raanajj^tnjum^t (1037) or criticism (1039). The ranges for these 
variables show that management statoincnts were most often used (from 34% 
to 79% of tho tlmo)» while criticism w.is only used rarely (from 0 to 30% 
of the time that all call uuts were corrected), 
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For the proportion of .corrected call outs that Included yarning 
atatenenttt, there was a significant curvilinear relationship found for 
Total Reading scores, but not for Word Analysis scores (1038; £ for Total 
Reading • .04, range • ,04 to .21). This curve depicts an invar ted S-shaped 
relationship for higher ability classes, and a very shallow relationship 
for lower ability classes. This suggests that a moderate amount of severity 
is sometimes the most appropriate correction for students in higher ability 
classes who call out. However, this yas not true for lower ability classes. 

No significant relationships were found for similar variables which 
separately examined corrections to accepted and unaccepted call outs (1020- 

1024). * ' 

Use of comments . Student comments on classmates* responses were not 
used very of ten by any teachers, and within the range available for analysis 
there were no significant relationships for the proportion of response 
opportunities receiving comments for Total Reading scores. However, there 
was a significant Interaction for this variable with Word Analysis scores 
(665; £ « .03, range *» .000 to .002). This Interaction shows a negative 
slope for higher ability classes and a very shallow positive slope for 
low ability classes. However, the low frequency of occurrence does not 
allow meaningful interpretation* and the result probably represents a few 
teachers using comments very few times. 

Use of undesir able type s of qu estions. Tliere were no significant 
relationships with either criterion for the average number per observation 
of each type of undesirable questions rhetorical (A045) , answering one*s 
own qticstion (A0'*6) , askinK a series of questions without stopping for 
answers (A047), miscellaneous undesirable questions (4048), or the total 




number of undesirable questions <A049) • There also weVe no significant 
relationships for the average rate per minute of the total number of undesir- 
able questions (4048)'. * 

There were significant curvilinear relationships with both achievement 
scores for the variable measuring the rate per minute that the teacher 

« 

answered her own questlont^ without waiting for student answers (4055; £*s 

> 

• .06, .04, range « .00 to .02). This range is fairly restricted, and the 

full distribution is positively skewed. Therefore, this result will not be 

interpreted, especially in view of the other results for undesiz^le questions. 

It must be concluded that the hypotheses about undesirable types of questions 

\ 

were not tested, because so few of them appeared. 

Sumraary of results for Principles 7 ,8,9,10,11, 6 12) . These principles 

dealt with calling on individual students in the group, and made su/^gestions 

• ■ 

that individual students be given practice and feedback about import.' at skills; 

that choral and group responses be minimized; that students should generally 

J 

be selected in order of seating with minimal volunteering and call outs; 
that call outs shoul^'^^^orrected, although not harshly; that students ^^.^ 
occasionally be asked to comment on another student *s answer; and that 
confusing questions should be avoided. 

There were strong relationships with achievement for some of the variables* 
measuring these principles, and weak or no relationships for others. The 
overall rate of interactions with the teacher, especiAjLly in nontum situations 
was positively related to achievement. That is, the more questions asked 

« 

of students ♦ the more the> learned* 

There were unexpected findings for omission of feedback. There were 
weak positive reJatlonships with achievement for the absence of feedback 
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following correct answers, although this occurred leas Jthan. ISZ 9t the. tim%. ^ 

Only a snail proportion of Incolprect answers received no feedback, hut 

within this range .^there were strong negative velationsfiipa with, achievea^nt. 

Therefore, it can be concluded that emission of feedback after correct answers 

/ . ' 

nay sometimes be appropriate, but essentially all incorrect answers should - 
receive feedback from the teacher. 

The rate of choral, responses was negatively related to achievement, 
although the rate of «group call outs showed an interaction (a negative rela* 
tionahip in higher ability classes and a positive relationship in lower 
ability classes). These results suggest that choral responses should be 
minimized in all* classes, but that occasionally allowing spontan£>us group 
call outs may be a useful «:echnique in- some classes , especially in classes 
of lower than average readiness. 

The data on types of initial selection showed very strong findings. 
In that the use of ordered turns was positively related to achievement, 
while use of nonvolunteers and use*of call<.outs showed negative relationships . 
There were few relationships for use of preselections, although there was 

* 

an interactive pattern suggesting that high use of preselection was nega- 
tively correlated for higher ability classes » but was weakly positively 
related to achievement in loweif ability classes* 

Several variables examined the typos of corrections delivered to call 
outs* Very few call outs that were accepted for tneir academic content were 
also corrected for the calling out behavior* Data describing corrections 
showed few significant relationships with achievement^ but there was one 
result sugRostmg that moderately sevi>re corrections are sometimes appro- 
priate for higher ability classes* 

•* 

- » 
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Requesting students to c<?iBBient on one ano there* ensirers occurred rarely, 
and the data are therefore not Interpreted. ■ 

The. use of confusing questions was also rare*and there were few. slgnl- 

* « 

f leant results. , 

Keapondm to Individual Differences within the Group Se tting (Principlea 13, 

« 

14, 15, 6 W 

Breaking up the group due to ability differences . There were no rela-' 
tlonshlps with either achievement scorf for the proportion times that 
reading groups were broken up due to ability dlfiferehces as suggested 1>y 
Principles 13 and lA (5338-5340). The ranges Indicate that , this occurred 
generally less than. 5Z of the time. The proportion of time that the observers 

* " 1 Oft 

judged that the group did not need to be broken up ranged from .84 to .98-, 
Indicating that the technique recommended by the Instructional model would 
not haye been appropriate most of the time. However; even the data from 
occasions when the observers judged that It was appropriate but was not 
used yielded no significant relationships. Therefore, this technique was 
not supported by the data as being U8,eful In this setting. 

iTwing a model within the group . No teachers were observed using this 
technique. Possible reasons for this are discussed in the preceding chapter. 

Arranging for tutorial help . No d.rect observational data were collected 
to measure implementation of this principle. It will be discussed in future 
reports dealing with teacher interview data and individual student data. 

Summary of results for Principles related to responding to individual 
differences within the group setting . No relationships with achievement 
were found for any of the variables measuring these principles. There was 
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v«ry poor Implementation this part of the nodel» yielding little or no 
variance on most of the measures. 

Responding to Incorrect Answers (Principles 17,18, 6 19) 

Use of terminal and sustaining feedback . Whenever a student did not 
answer a question correctly, the teacher had the option of providing terminal , 
feedback dr sustaining feedback . Therefore » a variable vas computed expressing 
the*ratlo. of terminal- feedback to the total of terminal plus sustaining feed<- 
back. The higher this score » the more the teacher chose terminal feedback 

« 

as a response to incorrect answers. There were signifioant n^gative linear 
relationships for total response opportunities (757|^ £*s « .01, .02, range • 
.40 to .6.6) and for nonturn response opportunities (759; £*s • .06, .07, 
range " .32 to .561. However it was. not significant for turn response 
opportunities (758; range •» .43 to .79). - . ' 

These ranges indicated that .ill teachers used texminal feedback some 
of the time, but the results suggest that too much use of it was related 
to lower achievement. Indeed, teachers with higher achievement scores 
used more sustaining than terminal feedback. 

It is not surprising that there were different resalts for interactions 

« 

occurring within reading turns and those outside of turns, because of the . 

♦ 

i 

pacing requirements of these different situations. Within reading turnst 

r 

it is important to maintain a steady pace of word-calling in order to under- 
stand the meaning of the text* Too frequent use of sustaining feedback in 

/ 

response to errors ^in turns would probably destroy the pace that is necessary 
• « 

to understand the in«itt>rlal . llowoyer, all teachers did use sustaining 
feedback some of the time during turns» and the lack of a significant 
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relationship with achievement for this variahle suggests that this was not 
detrinental ail the time. Probably, sustaining and terminal- feedback are 
each appropriate some of the time in response to errors in reading turns » 
depending on the content being read and the. type of error. Unfortunately » 
context was not described at that detailed a level. • 

On thd other hand, the use of sustaining feedback would not ^seviousiy * 
interfere with the paoe in most~l»(>ntum interactions, with the exception 
of fast^paced drills, which were not observed very often. In most nontum 
interactions., the teacher asked a single question for the purpose of teaching 
a skill and allowing practice with it. When errors were made, the use of 
sustaining fe,edback, especially in the form of clues, may have provided 
further information about the skill being taught, and it was given at the 
time that such information was needed (i«e., after an error). The pace of 
such lessons' was not as important as that of reading turns, where stopping 

* ♦ 

to work through some decoding skill would probably mean loss of practice 
of another important skill; "b^prehending the passage. 

* Types, of terminal feedback . In order to examine the effects of 
different types of feedback more closely, the separate categories were 
analyzed in a variety of ways. First of all, each type of terminal feedback 
was expressed as the proportion of response opportunities which inclu^dX 

For total interactions, the p'roportion that included give answer 
feedback was related to achievement, although this was curvilinear for 
Total Reading scores and linear for Word Analysis scores. For the Total 
Reading scores* the curve was an Inverted U-*^haped for both high and low 
ability classes. For the lower level classes, however, the relationship 
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was more clearly negative for scores at the upper end of the range (735; 
p • ,05, range • .04 to .19). For Word Analysis scores, there was a slgnl- 
flcant negative linear relationship for the projjortlon of total response 

« 

opportunities that Included ftlve answer feedback' (735$ • .01, 1^ange • .04 

« . • • * 

to .19). ♦ 

Therefore, when expressed as a proportion of all Interaction, more 
extensive use of give ansver feedback was related to lower achievement. • 
However, remember that this variable Included all response opportunities, 
both those which were correct and required no fj>edback. and those for which 
sustaining feedback was more ^propr late. The range Indicates that teachers 
at the high end on this variable were giving the answer In almost one out 
of five Interactions. This might reflect too high an error rate, and it 
might also reflect an unwillingness to use* sustaining feedback to errors, 
That is, giving the answer is not necessarily an undesirable . technique 
(the more effective teachers used it some of the time) , but this result 
suggests that It can be used inappropriately * 

There were no significant relationships with achievement for the 
proportion of turn (.736) and nonturn (737) response opportunities that 
. contained ^>lye answer feedback. 

The proportion of response opportunities containing ask other feedback 
was not significantly related to gain for cither total interactions (738) 
or nonturn interactions (739). The range of scdres for this variable was 
limited (from .01 to .09). It had been expected that this would be negatively 
related to achievej^ent , especially in lower ability classes. 

The occurrence of call out feedback was examined in the same way. 
The proportion of total response opportunities that contained call out 
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feedback showed different reeuXts for the two test scores. With Total Reading r 
scores, there were no significant results. For Word Analysis scores, there 
was a significant curvilinear U-shaped relationship that was generally 
negative in slope (740; £ - .01, range - .00 to .03). The restricted range 
demonstrates that calling out as feedback was infrequent when compared to 
all interactions. There were no significant relationships with either 
achievement score for the proportion of turn interactions which involved 
call out feedback (7A1). However, when nontum interactions were examined, 
significant linear interactions were found for both test scores (742; 2.* 
.03, .01, range « .00 to .02). The interactions depicted a negative linear 
relationship for higher ability classes, and a v6ry shallow positive one 
for lower ability classes. This same interactive pattern has been Jemon- 
stratcd elsewhere itj this study and in others (Brophy -rfnd Evertson, Note 1). 
Such interactions are interpreted to mean that cal ing out behavior (within 
limits) ma^ indicate enthusiastic participation in lower ability classes, 
but control problems in higher ability classes where motivation is not as 

much of a problem. 

To summarize the results for the types of terminal feedback (expressed 
^as proportions of-al'l interactions), negative relationships were found for . 
the use of giving the answer to students too frequently, and also for higher 
levels of call outs from students in higher ability classes. There was a 
' positive relationship (within a very small range) for call outs as feedback 
within lower ability classes, at least for nonturn Interactions. There 
were no significant relationships for the use of asking another student 

t 

for the answer. 

In <ltdcr to examine the single types of terminal feedback in more 

' 0 
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4epiX» variables were, created that expressed each specific type as t^e 
proportion of all terminal feedback that wa* used. These variables tell^ - 
us the relative Importance of the t^ree specific techniques when terminal 
feedback is selected as a general strategy. That is, if the teacher is not 
going to give sustaining feedback, is one type of terminal feedback more 
closely related to achievement than another? Is the appropriate use of 
terminal feedback dependent on the specific kind of feedback used? 

In the instructional model , giving the answer to students was consid- 
ered better than asking another student for the answer or having students 
call out feedback without permission. Therefore, positive relationshi/s 
were expected for the relative use of ^ivin<^ the answer , and negative 
results for the other two techniques. However, the proportion of terminal 
feedback that was give answer feedback showed no significant relationships 
with either achievement teat (760, 761, and 762). The ranges for this 
measure indicated that ^Ive answer feedback was used frequently when terminal 
feedback was selected as a general strategy. For total response opportunities, 
the range was .49 to .85; for turn Interactions, it was .74 to 1.00. and 
for nonturn interactions it was .23 to .56. 

This technique was used more frequently than other types of terminal 
feedback during reading turn interactions, and up to half the time that 
terminal feedback was used in nonturn interactions. Again, the more frequent 
relative use of f>ivinfi the answer to errors in reading turns probably reflects 
the pacing requirements of that settinR. Piv.ln£jthe_an^^ takes lesis time 
than the other types of terminal feedback, and this is an important considera- 

« 

tfon in readinp, turns. 

The proporition of terminal fooilbnok that was aJ>k.oiilfr showed signi- 



f leant curvilinear relationships for total response opportunities (763) ♦ 
but was not significant for nontum interactions (764). This variable waa, 
not examined separately for turn interact'lons, because of low frequency. 
The curves for l^otal interactions were inverted/ U-shaped, although much 
more shallow for Word Analysis scores than for Total Reading scores (jg^'s • 
.01, .OA, range • .08 to .39). This suggests that moderate use of this 
type of feedback is aiStpropriate when terminal feedback is being given, 
at least in nontum interactions. 

Earlier research which examined ask other feedback demonstrated 
different relationships for SES groups: it was positively related to 
achievement for high SES classes but negatively related for low SES 
classes (Brophy and Evertson, 1976; Note 1). The curvilinear result does 
suggest that too much use of this technique would not be advisable, but 
that It is not totally undesirable, at least in nontum interactions. The 
low rate of occurrence in reading turns suggests that most teachers find 
It inappropriate then, probably because of the effect on pacing. 

The proportion of terminal feedback that was a call out by another 
child showed no significant relationship for either test score (765, 766, 
767). 

These results do not yield any clear conclusions about the most 
appropriate type of terminal feedback. The appropriate use of any type 
of feedback is probably dependent on several factors, such as pacing 
requirements, student characteristics, and the extent of use. 

JJ££±?.L^}i^S:^S^^:^!i&^^^'^' three separate categories of 

8tij?taining feedback also were examined in the same ways to determine more 
about their effect on achievement. 



There were no significant relationships for the pro^rtlon of total 
response opportunities that Included repeating the question feedback (746). 
For turn response opportunities, there was no relationship with Total Reading 
. scores, but there was a significant linear interaction for Word Analysis 
scores (7A7; .04, range • .04 to .19). In this interaction, there was 
a positive slope for higher ability classes, and a negative slope for lower 
ability classes. There were no significant relationships with either test 
for the proportion of nonturn response opportunities which included repeat 
question feedback (748; range • .03 to .06). The ranges indicate that 
repeating the question as feedback was used most often in reading turns 
and seldom in nonturn interactions. It may be that it Is more effective 
with higher level students because they are more capable of figuring out 
for themselves what should be done to correct a misread word, and this is 

^ • * 

an efficient use of time within reading turns. Perhaps lo«er ability students 

• » 

need more information than is provided by simply repeating a question after 
a mistake. This technique might be effective when an error was caused by 
impulsive guessing or reading too quickly, but it would be less effective 
if errors were due to the lack of skills required to decode a word. If 
the latter type of error were more common in lower ability classes, then 
<»; makes sense that too frequent use of repeating the question would not 
be useful, because it would not provide the information which the child 
needed to correctly rtMd the word. 

The proportion of response opportunities which c-on,taincd clu e feedback 
showed no jiignlficnnt relationships for either total, turn, or nonturn 
Internet Ions 750, 7')1). The range here was small, from .06 to .10, 

indicating that few interactions included such feedback. 
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Tl^re also were no significant findings for the proportion of any type 
of interaction that was Rive by clue feedback (752, 753, 7541, The range 
was restricted on this measure, from ,00 to .01, reflecting the low level 
of use of this technique. 

The next set of variables expressed the proportionate use of each of 
these three techniques to one another. 

The proportion of all sustaining feedback that was repeating the question 
yielded no significant relatioj^shlps for total R.0.*8 (768). However, for 
turn response opportunities, there was a linear interaction with a positive 
slope for higher ability classes and a negative slope for lower .ability 
classes (769; £- .09, .01, range « .24 to .53). This is the same pattern 
which was demonstrated when repeating the question was expressed as a propor- 
tion of all response opp^tunities, and the interpretation is the- same 
(i.e., lower-ability students may need more information, whereas higher 
ability students can more often benefit from having the question repeated). 
Thert? were no significant findings for repeating the question in nonturn 
Interactions (770). 

Although no significant fitidings resulted when clue feedback was 
expressed as the proportion of all r«^3ponsc opportunities, there were 

« 

significant interactive results when it was examined as the proportion of 
all sustaining feedback in total and In turn response opportunities. 

For total response opportunities, the interaction was a negative 
relationship for higher ability students and a positive relationship for 
low ahlHty students (771; p « .10. .04. range « .47 to .70). For turn 
Interactions, this same pattern was present and the results were more 
highly significant (772; p « .01, p <. .01, range - .'O to .70). For 

t 
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nonturn interactions wit|) suacainlng feedback, there- vaa no aignif leant 
relationship (773). 

These results suggest that when a teacher decl<]es to use sustaining 
feedback within reading turn Interactions, it is probably better not to 
use clue feedback too much of the time with Higher level students. This 
result complements the ones discussed earlier for repeating the question . 
Higher level students probably do not need as much inforilation to correct 
their own answer, at least within reading turns, and pirovlding too mch 
of it probably breaks the pace. The ranges for these scores indicate that 
all teachers gave clue feedback some of the time when they used sustaining 
fe^4J)ack in turns > so this result should not be interpreted to mean that 
clue feedback should never be used with higher level students « It simply 
shows that too much of it yielded negative relationships. This was not 
.true with lower ability students » who apparently benefited from more clue 
feedback In reading turns compared to other types of sustaining feedback ♦ 
The implication is that when teachers want a student of lower ability to 
try to correct an -rror while reading (that is, they have decided on sustain- 
inR feedback rathor than terminal), it will probably be better to offer 
< hifs instead of simply urging the child to try again* 

The preportlon of total sustaining fecdhnck that was g1vi.r by clu e 
feedhaik slu)Wed no significant relationships with either test (774, 775, 

7/6). (;ive by clue feedback was used from 2% to 9% of the time that 

■ • • • <t 

i.ust ainitu; feedback was used* 

In summary of the data describing; the specific types of sustaining 
h » n.* sijMiifiiatU rt»lat ii^ifih i !><» were fount! for the use of give hv 
« ]tu* !♦ ♦MH).t. k whf>; i*xamiiM*<i in tlu\se ways% J^i^PJ^^itT 5ii5!?£i?^, feedback and 
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due feedback yielded significant interactions with ability when examined 
for reading turns. Higher ability students making errors in turns vho 
received more repeat question and less clue feedback had higher achievement* 
while these relationships were the opposite for lower ability cUsses. 

Feedback given when students fail to respond . The next three sections 
will look at feedback categories separately for three types of answers: 
failure to respond, incorrect answers, and statements of "I don*t ki»w". 

\This first section examined what kind of feedback is given when students 
fail' to respond. Therefore, the denominator for these proportions was "the 
sum of all no response answers" instead of "all interactions". 

The proportion of all no response answers which included give answer 
feedback demonstrated significant negative linear relationships with both 
test scores (833; £*8 • .01, .02, range - .19 to .55). The more often the 
teacher gave the answer to a child who had failed to respond initially to 
a question or word, the worse was the overall achievement. This does not 
mean that giving the answer is never an appropriate thing to do, however, 
because the bottom of the range represented teachers who did so almost 20Z 
of the time that students did not respond. When this variable was examined 
separately for turn and nonturn interactions, no significant relationships 
were found (83A, 835). 

The proportion of no response answers followed ly ask other feedback 
showed no significant relationships for either total or nonturn response 
opportunities (836, 837). 

The proportloi of no response answers which included a call out from 
another child as feedback showed no significant relationships for tptaj. 
interactions or turn interactions (838, 839). However, there were signi- 

I6« 
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f leant interactions for the proportion of no response answers In nonturn 
Interactions which Included a child calling out the answer (840; 2^ < .01, 
< .Ol* range «01 to .16). This Interaction Includes a negative slope 
for higher ability classes and a positive slope for lower ability classes. 
This suggests again that call outs are not desirable In higher ability 
classes (possibly because they represent management problems there), but 
they may represent s.omethlng very different In lower ability classes. 
However « this result mist be considered in light of the observed range, 
since call outs as feedback did not occur with great frequency. Indeed, 
other results from the study suggest that too many call outs are not appro-> 
prlate. These Interactions with ability suggest that a slightly higher 
level of call outs should be tolerated in lower ability classes because 
they may represent something desirable (motivation, enthusiasm, attention 
to the lesson). This does not mean that teachers of lower ability classes 
should encourage hlgh'^levels of calling out among their students « 

The proportion of no response answers which included repeat que st ion 
feedback showed no significant findings for total response opportunities 
(844) , but did yield a significant interaction for turn response opportuni- 
tics (8A5; » •08> •02, range « •OO to .14) • This interaction showed 
a positive slope for higher ability classes* This further substantiates 
the pattern fotmd when rep eat 1 ng t ho^ qit es t i on was examined with respect 
to all answers and all sustaining feedback * There were no significant 
findings for nonturn Interactions Including no response answers followed 

No rcsponj^o answers followed hy <*Jue fet*dbaok also yielded significant 
Interactions, as well as overall linear relationships with achievement* 
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For total response opportunities, there vas a significant interaction with 
a ateep tK>8itive slope for higher ability clatsaa and laaa ataep positive 



slope for lower ability classes, indicating that this technique was more 



model was considered, there was still a significant positive relationship 
(£*s - ,01, .01). This variable was not significant in separate examina- 
tions of turn and nonturn interactions, although the results were, near- 
significant and the slopes were positive. 

The proportion of no response answers (in total interactions) that 
were followed by i^ive by clue feedback showed a curvilinear relationship 
with ihe Total Reading test, but no significant relationship with the Word 
Analysis test. The curve essentially describt ' a positive relationship • 
(850; £ « .01, range • .00 to ,06). Obviously, this technique was not 
used yery often following failures tt> respond. When this variable was 
examined for turn interactions, there were significant linear interactions 
for both tests (851; £*8 « .OA, ,04, range » .00 to ,04), with positive 
relationships for both high and low classes, but much steeper slopss for 
lower ability classes. This suggests that, within reading turns, using 



s>. very easy clue question after a failure to respond is occasionally 
advantageous, especially In lower ability classes. There were no signi- 
ficant findings for this variable for nonturn Interactions (852). 

In summary, the following conclusions may be drawn from the data 
describing feedback to failures to respond: 

1. Giving^ thc|__answer to students without requiring another response 
has a negative relationship with achievement. It may be that doing this 



closely related to achievement in ^her ability classes (847; for 
interaction effect « .03, .04, range • .17 to .41). When the noninteractiv^ 
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\too frequently reinforces the failure to. respond » and this may cause students 
to give up too easily, therefore getting too little practice In figuring 

a 

out how to read. That is, if students know they can get the answer from 
the teacher without trying, they may be more likely to stop prematurely and 
ask for help. 

2. The relationship with achievement for other feedback techniques 
depended on the ability level of the class. The presence of some calling 
out by other students within a limited range was positively related to 
achievement for lower ability classes, but this relationship was negative 
for higher ability classes. This pattern was demonstrated with some other 
variables in the study describing calling out and in .previous research. 
Glueing feedback (i.e., breaking down the initial questiop into a series 
of simpler questions, and requiring another response) was positively related 
to achievement for both high and low ability classes, but the strength of 
the relationships within each ability group depended on the type of clue 
given. For regular clues, when the answer to the clue question was not 
an obvious "giveaway", higher level classes showed steeper positive slopes 
than did lover level classes. However, when much simpler clues were 
examined, there were steeper relationships for lower ability classes, at 
least within reading turn interactions. 

Another Interaction with ability level was present for repetition 
of the question after a failure to respond. Within reading turns, a 
failure to respond meant thJt the student stopped while reading the text 
and repcNiting_Jhe_qucstJoti meant that the teacher simply prompted the 
student emourat;ed an attempt. There were positive relationships 
with achievement in higher ability classes, m»i nep,ative relationships 
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in lover ability classes. 

These results suggest that optimal response by the teacher to a student 
failure to answeV a question will vary depending on the ability level of 
the atjudent. For higher ability students* the optimal response seems to 
be one that is somewhat challenging: ^pushing for an attempt to read the 
word within a turn, offering clues tl^t are noc too easy, discouraging 
call outs from other students who would give away the answer, and minimal 
use of giving the answer to the student by the teacher. 

However, for students in lower ability classes, the results suggest 
tltot feedback to failures to respond should npt.be overly challenging,. but 
should not reinforce the nonresponding behavior. Giving the answer to the 
student by the teacher shoi^ld therefore be minimized, in order ^to reinforce 
the expectation that students should respond. Allowing occasional call outs 
from other students who provide the answer is not inappropriate^ Giving 
clues 'is often appropriate, but at least some of the time, those dues 
should be very simple, allowing the student a guaranteed correct answer. 
'This appears to be especially Important in reading turns, where pacing must 

* 

be coiisldered. 

Such interpretations are in keeping with other research that has 
indicated that higher ability students in the early grades benefit from 
relatively more challenge, while lover ability students benefit from a 
relatively higher success rate and more encouragement (Brophy and Evertson, 
1976; Note 1). 

* 

Fee d bnck g iven to Incorrect answer s# In addition to examining these 
six types of feedback^ the variables describing response to incorrect 
answers also Included failure to provide feedback (l«e«» there was not 

* 
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even acknowledgenent of incorrectness)* 

The proportion of incorrect ansirere that were not followed by «ny 
feedback showed no significant relationships for total response opportunities 
(793), probably due to the very restricted range of scopes (fron .00 to .01). 
However, when examined for nontum interactions,, there was a significant 
negative linear relationship (79A; £ < .01, £ • .02, range • .00 to .02). 
Obviously, this did not happen very much of the time, but those teachers 
who occasionally did fail to give feedback to incorrect answers had lower 
achievement scores. This seems obvious, since ^students in this situation - 
were essentially receiving inaccurate information about reading, and/or the 
message that their performance Was not important. 

* « 

The proportion of incorrect answers (total interactions) that received 
give answer feedback showed a significant relationship for total Reading 
scores but not for Word Analysis scores . With Total Reading there was a 
significant curvilinear relationship, with both low and high ability groups 
showing Inverted U-shaped curves. However, for the low ability group, the 
curva dropped off much more steeply after teoking. For the high feroup, it 
leveled off more gradually (803;- p « .02, r^nge - .21 to .49). This suggests 

. high levels of giving the answer to incorrect responses is especially 
undesirable for lower level students. However, no significant relation**^ 
sh p was found for the Word Anelysls test for total response opportunities, 
nor were there significant results for turn and nontcrn interactions for 
either test score («0A, 805). Tlicrefore, this interpretation remains 
tentative. 

The proportion of incorrect answers tluit received as k othe r feedback 
showed no significant relationships for cither test for either total or 
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xionturn interactions (806, 807)* 

t^e proportion of incorrect answers that received call out feedback 
for 'total interactions showed significant curvilinear relationships (808; 
£*8 • .10, .01, range - .00 to .06). The curve for lower ability classes 
suggested a weak positive relationship. For the high classes, the curve 
was primarily negative in slope with a short upward curve at the end. 
Therefore, even though curvilinear, the pattern is essentially the inters 
action de tec fed earlier for call outs: negative relationships in higher 
ability classes and positive relationships in lower ability classes* This 
relationship was not found when separate analyses were done for turn and 
nonturn interactions (809, 810).' 

The proportion of incorrect answers that received repeat question 
feedback shoved a significant curvilinear relationship (inverted U-shaped) 
for total response opportunities for the Total Reading test (814; £ « .06, 
range « .12 to .30). For the Word Analysis test this variable showed a 
significant linear iciteraction (814; £ » .04, range - .12 to .30) with a 
positive slope for high classes and a negative slope for low classes. 
Separate analysis of this variable for turn and nonturn response opportuni 
tics yielded np significant results (815, 816). 

For- total response opportunities, the proportion .of incorrect answers 
that re<^eived clue feedback showed no significant findings, although there 
were near-significant results indicating a positive linear slope (817; 
range * .15 to .33). When turn and nonturn interactions were examined 
separately, no significant relationships were found (818, 819). 

Tlie proportion of incorrect answers which received give by clu e 
feedback showed no significant relationships with gain for total tnter- 



-163-1 72 



actions > .turn* or nonturn Interactions (820» 821 » 822). 

Incorrect answers were divided into reading questions *and nonreading 
questions to determine if this finer analysis would reveal a different 
pattern of findings. That is> would the appropriateness of feedback vary 
according to these types of questions? The follotSing patterns were evident: 

1. There were no significant relationships with achievement' for any 
of the variables including nonreading questions. These were examined for 
nonturn interactions only, since so fev nonreading questions occurred in 
turns. 

2. When reading questions were examined separately, a similar pattern ^ 
of results was found to that already discussed for all questions that yielded 
incorrect answers. Only the results that were different are discussed below. 

There wer<^ no significant relationships for giving the answer to 
incorrect rejading questions <888, 890, 891), whereas analyses involving all 
questions, yielded a curvilinear (inverted U-shaped) relationship for tot^l 
R.0.*8 with one test. 

A significant negative linear relationship was found for the use of 
asking other students for the answer in nonturn reading questions (892; 
£ « .02, .03, range » .03 to .31). In contrast, there were no significant 

findings for a^sklng others after Incorrect answers for all questions combined. 

A 

More significant findings were evident for variables describing repeat 
qu estion feedback. When all questions were combined, there were significant 
relationships only for total response opportunities, but for reading questions 
there were significant results for all. three types of interactions. For 
tctal and turn response opportunities, relationships were curvilinear. 
Inverted U-shaped, and similar for both ability levels, For nonturn R.O. *s. 



the curves suggested an essentially positive relationship for higher ability 
classes, with no clear relationship for lower ability classes. 

These results suggest that moderate amounts of repeating <^ueation 
feedback are appropriate, but that the optlinal level is dependent on the 

* 

ability level of the students* This same pattern has been discussed 
elsewhere for other variables describing repeating the question * The inter- 
actions with ability are probably due to differing needs for Information 
in order to correct an answer. 

Weak positive linear relationships were found for use of clue feedback 
following incorrect answers to reading questions (total response opportunl- 
ties) (902; £^s « AO^ •O?; .15 to .36). This variable was not significant 
for all questions combined* « 

In sunBaary, the following conclusions may be drawn from the data 
describing feedback to incorrect answers: 

1* Many of the same patterns found for feedback to no res^nse answers 

were evident* but they were not as consistent or as strong* This suggests 

that, as expected^ a failure to respond and a response that is incorrect 

require different things. of the teacher* In the first case^ the task is 

relatively clear cut; to encourage the student to say something* (This 
• * 

V 

point was strongly emphasized in the instructional model*) However, when 
the student has answor'^d inobrroctlyt the toach'*r*s options are more likely 
to be defined in terms ol the error itself and its Importance in the lesson* 
at that pointf^ Thercforo^ the objt t hen innos providing the correct infor- 
mation in the best way* ^ 

2. living the answer to thi» j;tuJent* whieli showed strong negative 
relationships with achievement for nV) responf^e answers, was only weakly 
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related to achievement following incorrect answer*. This seeas reasonsble, 
in that too Xrequently giving the answer after a failure to respond may 

I 

indeed reinforce that behavior, but giving the answer after an incorrect 
answer may be the most efficient way of providing the correct information. 
However, the data do suggest that too much use of the technique, following 
incorrect answers is not appropriate. 

3. There were interactions with ability for the use of repeat question 
and call out feedback similar to those already described (higher ability 
classes had higher achievement with fewer call outs and more repeating the 
question , and the reverse was true for lower ability classes). However, 
again, these were not as strong as they were when examining failures to 

respond . »^ 

4. The strength of the relationship with achleveinent depended on the 
type of question. There were no significant findings when nonreading 
questions were examined separately. However, when reading questions were 
examined, a similar pattern of results emerged to that already described, 
and for some variables the results were stronger. Of particular importance 
here was a negative relationship with achievement for asking another student 
following an Incorrect answer. This Is the only Instance of a negative 
finding for this technique, although the original hypothesis was that It 
would be neeatlvoly related to achievement. 

Feedbacjc _&iv_en_ to ;;i_do^^^ The same types of feedback 

variables were created to express teacher responses to answers of "I don*t 
know" or requests for help. (In the model, there was much emphasis placed 
.on eliciting some kind of response to every qiKstion, with the unders vandlng 
that it is often appropriate for the child to say "1 don't know", although 
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it is not appropriate to say nothing*) 

However, **I don*t know'* answers did not occur very often, so that many 
of the feedback categories associated with them were not editable for analyses 
due to low frequency. 

There were no significant results for use of ftive answer feedback (823, 
82A, 825), ask other feedback (826, 827), or- repeat question feedback (828, 
829) . Calllnft out by other students and giving the answer by a clue were 
not examined for "don't know" answers due to low frequency. 

The only significant finding for the cluster of variables describing 
feedback to "I don't know" answers was for the use of clue feedback in 
nonturn response opportunities. Here, the relationships were curvilinear 

» 

(832; £'8 • .OA, .05, range - .10 to .47). For both ability groups, these 
curves showed essentially positive relationships with a plateau for high 
levels of the variable. This suggests that giving a clue when students 
adialt they don't know the answer Is an appropriate thing to do, at least 
within the range of that behavior that was observed. 

• Results of sustaining feedback . In addition to looking at relationships 
between achievement and types of feedback in different situations, the ^fects 
of sustaining feedback also were examined. Every time J:hat the teacher 
gave sustaining feedback, the observer noted whether or not it led to an 
improved response In the next interaction. Iro provement was defined as any 
correct answer or, in the case of an initial failure to respond, as making 
any response- Proportions were then created to express the number of times 
that such feedback led to improvoment.. 

The proportion of all interactions Involving sustaining feedback that 
resulted in Improvod answers yielded no significant relationships for either. 
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tptal, turn, or nonturn interactions (934, 935, 936). It had ^e«n expactad 
that teachers who got better results with sustaining feedback would be the 
©ore effective teachers, but this was not the case. The ranges on these 
variables showed that sustaining feedback usually resulted in improvementt 
although there was still variation among the teachers. For example, for 
total response opportunities including sustaining feedback, teachers' 
improvement scores ranged from 63Z to 77% of the time. Therefore, they 
were successful most of the time in eliciting a better* answer in the next 
interaction, although this war not necessarily thjs final correct answer. 
Therefore, these measures did not define whether or not the teacher led the 
student to the final solution. It might be that a measure of ultimate 
success or failure with a sequence of sustaining feedback would be a better 
Indication of the teacher's ability to use it effectively, and this in turn 
might be related to achievement. It seems likely that teachers who are 

able to accurately diagnose the cause of an error and lead the child " 

i 

successfully through ihe process of answering the question woulti be more 
effective teachers overall. However, this hypothesis was not tested by 
these particular variables. 

Each type of answer (incorrect, "I don't know", and failure to respond) 

* 

was also examined for improvement following it. This was done in two 
different ways. Scores were created which expressed the improvement ratio 
for ouly those interactions which were sustained (i.e., those which could 
be completely categorized as either improved or not Improved). Also created 
were variables expressing the proportiQn of improved answers out of all 
such answers (I.e., those which included sustaining feedback, as well as . 
all the tiroes that the answer was not sustained). 

J 77 
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' For thfe first type of variable, no relationships were found for the 
proporl^ion of sustained incorrect or no response answer** that ware iaproVed 
(928, 9A2). However, when "I-<ion*t know" answers vera considered, there 
was a significant interaction for the proportion of these which were sustained 
and improved in nonturn response opportunities (940i £ - .02, .06, range • . 
,A3 to .76). this interaction showed relationships with achievement which 
were positive for higher abUity classes, and negative for lower ability 
classes. It is not clear why there was a negative finding for low classes, 
\ especially in light of other findings that suggested that clues which 

guaranteed Improvement were positively related to achievement in these 
classes . 

When the proportion of each type of answer that was improved was 
examined, positive relationships with achievement were found for incorrect 
answers (937; £*s - .06, .09, range « .23 to .43). Since these variables 
were eAamining the proportion of effectiv e sustaining feedback to all other 
types of feedback, and since most sustaining feedback was effective, these 
results may actually reflect the general appropriateness of using sustaining 
feedback much of the lime. However, there were no significant findj.ngs 
for this variable for "I don't know" answers (939). Again. resulCS for 
"1 don't know" answers do not fit into a pattern established for other 
types of answers. This might be due to their low frequency, which could 
lead to unrt-llable results, or it might be that they actually represent 
a qualitatively different situation than incorret t answers and "no rospons*?" 
* answers . 

Each type <>1 sustaining. it't'Ub.'i.'k was oxaiiuui'd tor the proportion that 
resultod in improvoU responses. N't> st juti f icant r* latiotwhips with achieve- 



ment were found for any of the three categories (944 - 951). Not surprisingly, 

« 

give by clue feedback more often resulted in success when It was used, but 
relative success with this or any other type of feedback did not predict 
achievement. These support the more general variables already discussed 
which showed that effective use of sustaining feedback as it was measured 
did not relate to aci^ievement* 

Another stt of variables w s created to examine the relative length 
o» a series of sustained interactions* in order to determine if teachers 
who gave up before ultimate success differed from teachers whc usually 
continued 8u«?taining sequences through to the end.* The variables expressed 
the proportion of .sustained interactions which did not include the final 
lorrect answei that were terminated rather than sustained further. It might 
be predicted that the relationship of this variable to achievement would 
be curvilinear, in that giving up and offering terminal feedback too much 
of the tfine might communlcat<; "igative expectations, while never being 
willing to stop bt'fore success ocuJd seriously disrupt the pace of the 
lesson. However, there were no significant relationships for this variable 
for total, turn, or nonturn interactions (662, 663, 664). Values ranged 
trum ^0% to 50% for sustained interactions receiving terminal rather than 
further sustaining feedback. 

Suimaiy ol roiiultu f or Prino iplt^f; d escribing fvodbr.ck to i n corre ct 
.in!.W"t.<t (!'r i nc i t>l t\{ .v^ i'^;. The prityMples in the model suggested using 

RvjKt.iiniiiR feedback in response to errors when it seemed appropriate. Wlien 
it was n<-t appropriate (due to paring o' type of question), it was suggested 
thai the teach«r give the anjwer to the student herself r<?ther than ask 
»»»h»'r stud«'Hf.»s. 
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In a very general sense, these principles were supported by the data^ 
but the results suggested that many factors must be considered in defining 
their relationship with achievement. There were several statistical inter- 
actions with the initial readiness level of the class, and results were 
often different when separate analyses were done for response opportunities 
during reading turns and those outside of reading turns. . 

Sustaining feedback was positively related to achievement, when examined 
In comparison to terminal feedback. Ho»;ever, the results indicated that 
terfn^nal feedback was used by all teachers muca of the ti&e« Itie differences 
between the more and less effective teachers was in the relative aiaount» 
with the more effective teachers using .^usu ining feedback up to 60Z of 
the time that they had the choice of the two general strategies « In addition* 
the proportion of incorrect answers and failures to respund that were improved 
through the use of sustaining feedback were positively related to achievement* 

When specific types of feedback were examined, the relationships with 
achieveniont were dependent on both student ability level and the type 6f 
answer preceding the feedback « 

Terminal feedback categories: 

Giving^ the an swer showed negative relationships with achievement, and 
this result was strongest when failures to respond were examined* However, 
all teachers, even the most effective, ust'd the techniq.te some of the time# 
The results therefore suggest that it should be used ir a. -^deration. 

Askinj; oth^r stm^^^ for the answer did not occur vory often, and 
there were few relationships with airhleveiuent for Its use. One significant 
flndln*|» imllcated a negative relationships while another suggested a 
curvilinear relationship in which tmuierate use was relate*! to achlcvetnent • 
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This was contrary to %::xpectation8 based on other research. 

Ca ll outs from other students yielded interactions with class mean 
ability, in that there were positive relationships with achievement within 
lower ability classes, but negative relationships within higher ability 
classes. However, there was not much calling out as feedback, so that 
the positive relationships in low classes do not imply high levels of the 
behavior. 

Sustaining feedback categories: 

Repeating the question often showed interactions with ability, in that 
its use within reading turns was positively associated with achievement for 
higher ability classes, but there was a negative relationship for lower 
ability classes. Tbis was interpreted to indicate that lower ability 
students often need more information, In order to impiove an answer, but 
that higher ability students, given some additional time and encouragement, 
may be able to reason out a word that they originally hesitated on or missed. 

Clue feedback following errors or failures to respond showed positive 
relationships with achievement, although again, this was strongest following 
fai es to re8i>ond, and especially in higher ability classes. 

Give by clue £e«^dback did not occur often, and yielded few significant 
rolationshlp*^-. However, Its use was positively related to achievement when 
following failures tc respond. This «;ifect was strongest In lower ability 
classes. 

A toacht'r*s rate of .'5ucccs>s with sustaining feedback (i.e., whether 
or not It led to an improved answer it. the next interaction) did not 
proi'' a» !'« ''voraent . Most sust-iini nj; fft dbark was siu ri'ssful in this 
respec t . 
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Feedback to Correct Answers, (Principle 20) 



There were no significant relationships for the proportion of correct 



answers followed by emphasis feedback for any type of interaction (780, 781» 
782, 83A, 863, 864, 863, 910, 911). Emphasis , as it was measured in this 
study (repeating the answer or having it repeated) , showed no relationships 
with achievement within the observed ranges. The proportion of correct 
answers (nonturn interactions) followed by emphasis feedback ranged from 
26% to 50%, indicating fairly frequent use of this type of feedback. The 
range was much smaller in reading turn interactions (0 to I4Z) probably 



because the teacher wanted to maintain the pace and repeating trords would 
have been an unnecessary interruption. 

It had been expected that omitting feedback after answers would be 
negatively related to achievement at this level. This was true when 
incorrect answers were analyzed* However, v^en the proportion of correct 
answers that received no feedback was examined* there were weak positive 
linear relationships for total interactions (773; " •^^f •^^^ range • 
♦ 00 to This variable was not examined in reading turns due to low 

freqttency of occurrence. 

When broken down into types of questions, the proportion of correct 
reading questions that receJv<»d no feedback showed similar relationships, 
either weak positive or near--signif leant trends in that direction (861, 
863), However, there were no significant relationships for the proportion 
of correct nonreading questions that received no feedback (908, 909) ♦ 



Although it had been €»xpect«Hi that emphasJLs feedback (repeating or having 



Svnmi nj of z osuj t for Principl o 20 ( rr<^ponding to correct answors) * 
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• child repeat the answer) wo«ld be related to achleveiieat» no relationships 
' w«re found* Teachers did use this type of feedback fairly often in nonturn 
Interactions (use ranged from one In every four, to one in every two inter- 
actions) ♦ 

« 

It had also been expected that failure to give feedback to correct 
answers would be negatively related to achievenent» since it would represent 
lack of Information given to the student about an answer. However, there 
were weak positive relationships with achieveaient found for the proportion 
of correct answers that did not receive feedback. Omission of feedback tc 
correct answers did not occur often (n# more than 15X of correct answers 
received ^o feedback) . Perhaps omission of feedback is appropriate when 
it is obvious to the students that an answer is correct, and acknowledgement 
of this would be unnecessary* * 

\ 

t 

Praise and Criticism (Principles 21 S 22) 

Praise ^ Two types of praise were examined: praise during acadeuic 
interactions (response opportunities) and praise of behavior. The absolute 
rate of occurrence of each was not related to achievement (27» 425). 

The proportion- of all contacts, including response opportunities and 
behavior contacts, that included praise showed no significant relationships 
with the Word Analysis test, but significant curvilinear relationships with 
Total Reading scores (^033; £ « .05, range « .04 to».14). The curves for 
both groups were shallow inverted l)~«hapes, suggesting an optimal amount 
of praise in the middle of the range. However, the lack of significance 
tor the Word Analysis test makes this interpretation* tentative. 

Wlien only academic contacts (response opportunities) were examined. 
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th9 proportion (total i/iteractioos) including praise waa significantly 
negatively related to the Total Reading scores* although not to Word 
AnalyBis scores (730; £ "* .04, range » .04 to .17). There were no signifi- 
cant findings for the proportion of turn response opportunities' that included 
ptaise, probably due to the very restricted range (731; range « .Op to .OS). 
However, when nonturn interactions were examined, the proportion that received 
praise showed negative linear relationships with both test scqres (732; 
£ " .02, .08, range « .04 to .19), 

When only behavioral contacts were examined, the" proportion of these 
with praise showed significant linear interactions Vith both test scoi;e8 
(1014; - .09, .02, range » .00 to .08). These interactions showed a 
positive slope for higher ability classes and a negative slope for lower 
ability classes. However, the distribution of this variable was extremely 
skewed, so that the results may be artif actual. Other research has suggested 
that lower ability students probably benefit from Aore praise relative to ' 
higher ability students (Brophy and Evertson, 1976; Note 1). 

- When only correct answers to academic questions were examined, the 
proportion receiving praise showed no significant relationships to gain 
for any type of Interaction (785, 786, 787, 868, 869, 870). 

Ttte use ofi praise following reading turns that were completely correct 
snowed a negative linear relationship for the Total Reading score (855; 
2 » .05, range « .04 to .30), but this variable was not significantly 
related to the Word Analysis scores. 

The use of praise following Incorrect answers showed no significant 
relationships to achievement for either total or nonturn Interactions, 
probably due to the very restricted range (?99, 800; range « .00 to .01). 
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However » the use of praise following s reeding turn that contained sone 
errors showed a significant negative linear relationship with Total Reading 
scores, although not with Word Analysis scores (859; £ • .04, range • .04 
to .33). ^ 

Specificity of praise . There v^ere no significant results for the 
proportion of all praise (academic and behavioral) that was specific (1034) • 
When only academic praise was examined for specificity, -there was a positive 
linear relationship with the Total Reading score, but not with the Word 
Analysis score (756; £ » .04, range - .01 to .08). ' 

When only behavioral .praise was examined, there w^re no significant 
relationships to athievoneitt (1029). 

Criticism . Criticism was also examined for both academic and behavioral 
contacts. There were no significant results for the absolute rate of occur- 
rence of either type (28, 429). 

The proportion of all contacts (academic and behavioral) that were 
critical In nature showed significant negative linear relationships with 
achievement (1035; sl ^ £ < .01, range « .02 to .10). This variable 
included academic criticism^ behavioral criticism and behavioral warning. 
It did not include behavior corrections that were mild in tone. 

When only academic criticism was considered, there were no relationships 
with achievement for either total or nonturn interactions (733» 73A). 
Academic criticism was rare, occurring in less than 10% of all response 
opportunities* 

When only Incorrect answers receiving criticism were examined, there 
were iilso no significant findings (801, 802^ 886, 887, 921). ^ Criticism 
was given to incorre«"t answers less than 5% of the cime. 
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» 

- * 

Specificity of criticl8» « The proportion of all criticism and correctiva 
contacts, that were specific > showed positive relationships with achievement 
(1036; » .06, .02, range - .02 to .10). This variable suggests that 
teachers who were specific about their criticism were getting higher achieve- 

« 

ment than teachers who were not> at least within the narrow range observed « 

However > when only behavioral contacts were examined for use of 
specif icity> there were no significant relationships (1019> 1030) « Academic 
criticism was not. examined separately for use of specificity due to the low 
frequency of occurrence* 

♦ 

Summary of i^esults for Principles 21,6 22 (praise and criticism) • The 

♦ 

use of acadeiplc praise was negatively related to achievement, suggesting 
that too>much praise iS inappropriate. These results were strongest for 
nonturn interactions. For many of the variables describing praise, results 
were only significant for the Total Reading score, which suggests some * 
caution in interpretation, since most ol the other variables were related 
similarly to both tests. * 

As expected, use of specific academic praise was related to achieve-* 
ment, but It did not occur often (less than 8% of praise was specific). 

There were negative relationships with achievement for the proportion 

> 

of contacts that were critical in nature. This Is a reflection of more 
critical behavioral contacts, since there were relatively few instances 
of acade ic criticism. 

When examined separately* there were no significant relationships 
with achievement for academic criticism* 

The proportion of total critical statements that were speciiic w«s 
posftively related to achievement. 
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♦ • • 

. Time Usage , . ^ 

There were significant relationships with achievement for th^*average 
time spent in reading groups. (This included transition time as well a^ 
lesson time.) For the Total Reading scor4, .this relationship was positive . 

« 

and linear (4035; < .01, range • 21.24 minutes to 31.84 minutes)^ Foi^ 
Word Analysis scores, the relationship was curvilinear (£ ■» .04). The* • 
shape of this curve was similar for both low and high groups, and showed 
a positive slope up to a plateau. ' '» • 

Similar results were found for the variable "Average response opportu- 
nity time available". This variable measure t^^e average time each riding 
group spent in actual academic lessons, thus eliminating the transition , ' 
time prior to the lesson. For both test scores, these relationships wtth v 
achievement were curvilinear (4029; £ • .02, .02, range « 18.29 to 28.26), 
and the curves were again positively sloped up to a plateau. For Word 
Analysis, the curve for the lower ability classes peaked and leveled off 
much sooner, while the slope for the higher ability classes continued to 
climb to a |tigher point before plateauing. These results suggest that the 
longer students were exposed to instruction in lessons, up to a point, the 
more they learned. The optimal amount of time was pdorhaps slightly different 
for lower and higher ability students. This makes sense considering that 
attention spans were probabJy different tor the two groups. 

The number of students in each reading group and the number of reading 
groups per class were also analyzed. The average number of groups seen in 
a morning showed no relationship to Total Reading achievement, but a 
positive lincat relationship for Word Analysis achievement (4069; £ » .05,. 



* range « 2.62 to 3.75). It nay be that a greater number of groups reflect 
more careful pairing of instruction with &biXity« level. It would be expected 
that this result also would be reflected in the average group size, because 
more groups should mean fewer students per group. However, there were no 
'significant relationships for the average group size in the class (4070; 
range « 5.65 t;o 8.39). 

The iVAmber of activities assigned to the students during each reading 

ft 

group was counted • These were. worksheet exercises or other work that 
(followed up on material taught during the reading group. The work might 
be done* within the group or taken back to the students* seats to be completed* 
There were no significant relatlanshlps for the average number cf activities 
given during a group lesson (5352; range - .59 to 2.22). 

The response oipportunity time was coded as to the lesson context used. 
Five lesson contexts were possible: 

Slov^ paced questioning and answers without use of the basal text 
and without workbooks « 

^ 2. Workbook activities in which the students received instructions 
on performing exercises and/or did these in the group. 

3* Fast-paced drill. In which students were expected to respond to 
the teacher^s questions at a very rapid pace» such as in flash card drill* 

4* Reading c<loud of a new story from the basal text* This involved 
cither silent or oral reading of material which students had not seen 
before* It would also include any comprchons Ion question'^ based on that 
tnaterlal* 

5* Rereading of a story from the basal reader. This involved either 

silent or oral reading and/or comprehension questions over material the 

« 
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students had seen before* 

The average time per lesson spent In each of these contexts was computed 
for each teacher. There were positive linear relationships for the average 
time spent In Context l-slow-paced questioning without the reader or workbook 
<A030; 2 " 'Ol* 'OZ, range • 2.11 to 9.98). There were no significant rela- 
tionships for time spent in contexts 2, 3, 4, or 5. Some of these approached 
significancfi for one of the two tests; in all such cases* the slope was 
positive and linear. These results might reflect total time spent, in that 
greater time overall might be related to move time in any given context. 

The proportion of time spent in the different lesson contexts was also 
examined. The proportion of the total response opportunity time which was 
spent in Context 1 (questions with no student materials) showed positive 
linear relationships with achievement (4063; £ • .03, .03, range • .10 to 
.39). There was no significant relationship for the proportion of time 
spent in contexts 2, 3, 4, or 5 Although not significant, the slopes 
' for Context 2 (workbook) were negative, for 3 (drill) they were positive, 
for 4 (reading from basal texts) they were negative, and for SJrereading 
Stories) they we/e very close to zero. 

These data suggest that the use of the first context is important with 
its focus on teacher questions with no student materials* These results 
do not suggest ♦ however, that all time should be spent in that context > 
because the top of the range represented use of this context no more 
than S0% of the time. Examining groups of different ability levels or 
higher grade levels might reveal different patterns of relationshipCe 
As students ftain ability to rend aloud smoothly, they might benefit more 
from time spent in contexts 4 and 5 (reading of old and new stories from 
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the text) than they would earlier In their reading Instruction. 

Another measure was tine that the teacher spent out of the group once 
the lesson had hegun, and it was ^pected that this would reflect teachers* 
management ability. However, there were no significant relationships %rith 
achievement for the average time the teacher was out of the group or the 
average number of times per obse. ation that the teacher left the group 
(A036, A037). 

• Another way of looking at- use c ime is the rate of response opportu- 

* 

nities offered to students. This alt*. ^ has be^n discussed under Principle 7, 
but it will be discussed further here. Ther.e were positive relationships 
with gain for the rate of all response opportunities given, and especially 
the rate of nonturn response opportunities offered. There were no signi- 
ficant relationships with the number of reading turns per minute* of fered 
to the students. 

The results suggest that the more, interactions a child has with the 
teacher, especially tn the form of single questions and answers, the more « 
that child will achieve. This complements thw results for lesson contexts, 
since Context 1, which showed positive relationships with achieveme.nt, 
would allow for more such interactions. 

Since there was mucti emphasis in the model on use of sustaining 
feedback, it was of interest to know how this affected the overall rate 
of response opportunities in relationship to achievement. The proportion 
of response opportunities that were initial selections rather than sustained 
selections showed no relationships with achievement (645) . 

Summary of ronults of timo usa^e variables , These data indicated 
generally positive relationships with achievement for the amount of time 

ioo 
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8pettt in reading group lessons* However* this relationship vas curvilinear* 
suggesting that past a certain point* more instructional titte does not 
yield greater achievement. Other analyses suggest that a format' allowing 
oral teacher questions and answers by individual students is important. 
Several variables describing such a format showed positive relationships 
with achievement, while variables describing oral reading or workbook 
activities in the group were not significantly related to achievement. 

There were positive relationships for the number of reading groups 
seen each morning, although t;he range was only from 2.60 to 3.75 groups. 
There were no significant findings for the number of students per group, 
although this might be expected to vary with the number of groups. These 
results might represent a careful pairing ^of instruction with ability 
level by the more effective teachers. This could result in more groups, 
but not in equal .distribution of students if that was not appropriate 
instructlonally. 

Ctirricvilxm and Content Covered 

Variables Included in this section were analyzed at the reading group 
level, since the curriculum and content covered varied within each class 
by reading group. Therefore, the N for these regression analyses was 66, 
rather than 20, (Reading groups that were not present for the entire 
year were not Included in the regression analyses, since tl^ere were no 
appropriate test scores fojr them. ITierefore, fewer groups are (ncluded 

» 

hare than In the group comparison.) Only Total Reading scores were used , 
as a criterion since earlier analyses at the class level indicated that 
roost results were similar for th£' two teat ttcorcs. 
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The content covered during the /ear showed significant relationships 
with Total Reading achievenAt. The reading level completed at the end 
of the year was positively related to achievement, and there was also £ 
significant interaction (6001; £ < .01 for interaction and for main effect, 
range • 1.70 - 3.72, where a score of U indicated that the students have 
completed the first reader In the series, usually considered to be the 
Urget for the end of first grade). The interaction effect for this 
variable occurred because there was a much steeper slope for higher ability 
reading groups than lower, although the slope was positive for lower 
ability reading groups also. A comparable variable, the number of basals 
completed, showed similar results (6006; p < .01 for both interaction and 
main effects, range - 3.45 - 6.10). A reading group that started at the 
first preprimer and went through all the books considered iippropriatr for 
the first grade would have completed six books. Again, although the over- 
all slope Is positive, it was steeper for hight-r ability groups than for 
lower ability groups. These two results taken together suggest that content 
covered is definitely related to achievement, and that higher ability 
students responded best and achieved more at a faster pace than that which 
seemed most appropriate for lower ability groups. However, even within 
lower ahlilty groups, those who covered taare content achieved more. TaIs 
interaction is comparablt* to different results found for high and low SES 
classrooms at the second- and third-grade level by Bn>.>hy and Evertson 
(Note n. They su>>gested that higher SES attulents (and therefore, presiuna1>l 
higher ability students on the averago) benefited from more demands by 
their teacher, whi'" lower SKS sttidents benefited from similar high expecta- 
tions for perfortnanoe, but with more enphasis on teduudtncy a«i«l careful 
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coverage of each skill* 

♦ 

There were four basal -series adopted by the school district for fir^t- 

* * # 

grade reading: •Economy, Harcourt-B race, Houghton-Mifflin and Scott- 
Poresman. The basal used aost in each reading group was noted, and these 
present-absent scores for each series were compared to the groups' achieve- 

' ncnt* ' 

There was a significant interaction with entering ireadiness level for 
the use of the Economy series (6002; £ - .02). There was a positive rela- 
tionship with achievement for higher level groups and a less steep negative 
relationship for lower level groups. 

However, the other three reading series yielded no significant rela- 
tionships with achievement (6003, 6004, 6005). 

Thfere were several measures which examined the use of other materials 
besides the basal reader as part of the Reading and Language Arts program; 
There were no significant relationships with achievement for the use of 
the' basal workbook (6007), although since almost everyone used this, the 
range was restricted. There were also no significant relationships for 
the use of commercial worksheets (6008), the spelling workbook (6009), 
the handw-iting workbook (6010), or the DTSTAR program (6012). There was 
a weak aiRuIficant positive relationship with achievement for the use of 
the English workbook (601 1 yji = .08).' Tliereforo, the use of additional 
commercial material showed Vo clear relationship with achievement. 

The size of the class and of the reading group was also examined to 
dftcrmine if smaller groups and/or smaller classes were related to achi**ve- 
tnont. Thfrr wi»r<» no relationships with acliievcment for the aven^ge size 
of tUv rvmMttiX r.roiip (6014), but there was a significan* positive rela- 

if) 3 

-184- ■ 



tionship for average class size for the year (60X9; £ • .03, range • 20.21 - 
• ♦ 

4 

28.79). This result suggests that there was greater achievement In the 

# * 

^arger clas'ses. This Is In contrast to a similar lapalysis done at the class 
level, where class size showed no relationship with achievement. It is 
not immediately clear why the results differ although sample size difference^ 
or dependence of sampling units (fn the case of the reading group analyses) 
may be possible explanations. There are analyses currently tafcing place 
with other data from this study that may shed some light on problems with 
different units of analyses (Martin, Anderspn; and Veldman, Note ^) • , . 

The stability of reading group^ membership wa^ measured by the number 
of changes of students during the year and also the relative 'frequency of 
change. These demonstrated interactions with the average entering ability 
of the group. For both variables there was, a negative relationship with 
achievement for more frequent changes within higher ability groups, but no 
clear relationship within lower ability gro\ips\(6015, 6016). These f^indlngs 
suggest that the more stable that higher ability groups are, the4>ettcr the 
Students will achieve. However, within lower ability groups, there is no 
Indication that stable membership contributes to or detracts from achieve-- 
ment, at least as stability was ncasurcd here. > 

Sinmar ^ of togros^ion d<^t<i for citrriculim used and content f<:overed ^ 



• 4» 
<4 ^ 



Use of the Economy series (with a phonics emphasis) interacted with the 
entering ability level of the reading group» so chat there were positive 
relationships wit^ achievement for higher ability groups^ but negative 
relationships for lower ability groups. No more effects were found for 
use of any basal series. There were no cle^ir relationships with achieve- 
ment for the use of additional commercial materials. However, there were 



r 
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clear effects demonstrating that wore content covered in the reading groups 
was related to achievement for both lowland high ability reading groups, and 
that a faster pace. of content coverage was better for higher ability groups*. 
Reading group size demonstrated no relationship with achievement and clastf 
i size 'demonstrated a positive relationship, suggesting that the Urger classes 
achieved more.* The variables describing stability of reading group member- 
ship suggested that higher ability groups achieve less when thero are more » 

changes in reading group memberships, but there are no clear relationships 

■ . * * 

with achievement for lower ability groups. 

Other Categories of Academic Teac h evsttident Interaction - 

Many_ji«rtregories that describe response opportunities have already been 
discussed in evaluation of the instructional mouel and tts recommendations 
for selecting^ students and providing* fee'dback. However, oth^r categories 
were also used to describe academic Interactions and are discussed below. 
These were not derived from the instructional model, but we were interested 
in their relati^mshlps with achievement. 

T ypes of questions . Nine categories of .questions were included in 
the coding system. Each type was expressed, as a proportion of resplbnse 
opportunities and compared to achievement. There were no' significant 
findings for seven of the nine: repetition, reading choice* word recogt 
nition, choice, product, comprehension, or Interpretation (666 - 672, 677 - 
68A). 

There were significant relationships with achievement for the use of 

- • 

word ajjack que Rtio ns. TliWe^wore questions which required the student, 
to talk about a sound made by. a letter or a part of a word, or to look at 
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a single word and. break it into its parts* This variable was examined for 
total and nonturn response opportunities only* because of low frequency in 
reading turns. The proportion of .total questions that were word attack 
qctstions showed positive linear relationships i673; £*s «* .02, *02, range «» 
.04 to .16). lliis.same pattern was repeated for the proportion of nonturn 

questions that were word attack questions (674; p*8 » .04, .0?, range • 

• - ■ ■ '• 

■ u07 to' .^0). This r^oes not suggest that teachers should spend all uf their 
time on word attack questions, because even teachers at the high end of 

* 

the range' only used such questions about 16% of the time* Hqwever, teachers 
who used more of these questions achieved higher reading gains with the4.r 
students than those who used less. ^ * 

There were significant negative linear relationships for the proportion 
of nonturn questions that were personal queat:U>ns 2's • .06, .M, 

range "> *'00 to .03). l^ls range was restricted, and tW& distribution was 
positively skewed so that a few teachers with higher levels of use were 
probably causing the§e results* However » the. result does suggi'.st that^ 
teachers who spent more of the time on personal questions rather than 
skill-related quest ions..*achieved lessVith their students* 

» . ..^ 

Because there was so much empb is placed on the use of sustaining 

# 

feedback In the Instfuctlonrl models the proportions of each type of 
question used In sustaining feedback were examined. . However > there were 
no significant relationships with achievement for any of these variables 
(653 - 659). Word recognition questions were used most commonly in 
sustaining JTiH^dback^ and they also were the most common type of question 
atkod when all response opporttmi t ies were exninined* 

T yp es A ? a nswe t s ( d 1 f f t c ty 1 eve 1 ) . There were highly significant 
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positive linear relationships for the proportion of total response opportuni-^ * 
ties which led to correct answers (690; £*s < .01> < •01, range * .62 to 
.77). However, this relationship w^s not found when nonturn response * 
opportunities were examined separately (691) . (Errors in reading turns 
are examined below.) ' • / 

* The proportion of total response opportunities that had incorrec t 
answers showed . a significant curvilinear relationship* for Tctal Reading 
scores (693; £ » a04, range »« .18 to .31). These curves are fairly *8hallow 
Inverted U*s for both high and low ability classes. The relationship of 
this variable with Word. Analysis scores was linear and negative* (693; 

\ 

p < .01). . \ 

The proportion of nonturn response opportunities that included incor^* 

rect answers showed' significant negative linea relationships with both 

test scores (694; 2*s • .08, .02, range - .^0 to ^16). 

There were no significant relationships with achievement for the ^ 

proportion of response opportunities that led to "don*t know" answers for 

either total or nonturn interactions (696, 697). (These did not happen 

» • 

very often, with the range for total response opport unities being .01 to .02.) 

« 

There were significant relationships with achievement for the proper- 
tJLon of response opportunities leading to no response ans«rers for total 
Interactions. This relationship was linear and negative (698; £'s « .04, 
.03, range « .07 to .17). There were no significanc findings. for the 
proportion of nonturn response opportunities leading to no response answer'iB 
(699).. - 

Krror3 ma'ig 1*^ ^^^^ rea ding turns. Whfenever a group was reading ^oud 
out. of the basal text, the observer notedyinteractions only when a student 
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made an error, and ,then separately recorded the quality ot reading turns 
as a whole* This means that most of the Interactions that occurred during 
turns came as a result of mistakes, although they Included correct answers 
ttiat followed sustaining feedback questions, -^e ^umber of response opportu 

^ * i 

nlties that did o.ccur jer reading turn Is an Indication of the number- of 

* • * • 

times* the reading ^topped because of words read Incorrectly or not attempted 

There were negative linear relationships with achievement for the average 

number of Interactions per reading turn (6C6{ £^s » .lOt .05^ range » 1.33 

♦ 

to 1.09). The number of Initial errors made per reading turn reflects the 

♦ « 

number of original Errors made by stud^lnts and not t,ny errors made during 

• • •■" . 

sustaining feedback interaction, and there als% were negative linear rela~^ 

tion^lpa with achievement for this variable (7Q1; p*8 •» .03, .0?, range 

♦ 

• .41 to .98). • * 

Correspondingly, there were positive linear relationships for the 
proportion of all reading turns that were completely correct, without errors 
(702; " .05, .03, range - .53 to .74)*/ There were no significant' 
relationship^^ with achievement for the proportion of interactions occurring 
during reading turns that included correct answers (703). 

Tlidse results suggest than when children read aloud » it Is better 
for the material to be easy enough that they can read with few mistakes. 
However^ these results could reflect the fact that students who make more 
mistakes In reading are more likely,^ to he those who will not achieve as 
much. It is dif/icult to say how much those results are due to this factor^ 
and how much they reflect more appropriate matching of material to students 
by the more effective, teachers. (Tt would be Interesting to examine this 
variable using only a subset of lowi^r lev*! reading groups.) However, 

* 



because these analyses were done with entering ability used as a covarlate* 
and because Interactions were tested for» It cannot be assumed that the 
results are due entirely to a confounding of ability^ level with level of 
error. • 

Level of errors for different types of questions . In order to examine 
the level of difficulty In laore detail, different types of questions were 
examined for the proportion of them that led to correct answers. There 
were slgnlf icanf positive ^linear relationships with achievement for the 
proportion of total reading questions that led to correct answers (952; 
p*s < .01, < .01, range - .56 to .75). This relationship was not $pund 
when reading questions asked during turn and nontum interactions were 

« 

« 

examined separately (953, 954). There ^Iso were no significant relation- 
ships for the proportion of nonreading questions that led to correct 
answers (955). 

* 

Each separate type of question was examined in the same way. There 
were significant curvilinear relationships for the proportion of reading 
choice questions that were correct for both total and nontum interactions 
(to^al: 706; 2*8 < .01, « .01, range - .75 to .89, nontum: 707; £*8 « < .01 
• .01, range = ..75 to .89). *In all cases, the curves, were very shallow 
inverted U-shapes. This suggests an optimal moderate point of difficulty 
for such quest ions • 

There was a positive linear relationship for the proportion of total 
v ord recognition questions that were answered correctly (708; £*s » .01, 
< .01, range « .45 to .67). This result suggests that within the range 
avatlablo. teachers who ask easier questions produced higher achievement. 
This probably is a reflection of optimal matching of material to students. 
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It does not mean that the teachers never challenged the students with 
difficult laaterlal, but instead, that most of the time (close to 70Z), 
they were asking questions that could be handled by the students* However, 
this* result was not replicated for turn and nontuxn interactions analyzed 
separately (709, 710)* It might be that analyzing these vari&bles separate 
ly by ability levels would produce significant interactions not apparent 
with the data aggregated by class. 

There was a significant interaction for the proportion of total 
personal questions answered correctly, as well as for nonturn persona l 
questions* The relationship was positive for higher ability classes, but 
with a slightly negative or zero slope for lower level classes (71A; 
£*8 » .02, *02, range * .81 to 1.00). These distributions were somewhat 
n&gatively skewed, and personal questions did not occur very often, so 
the results may not be meaningful. 

The proportion of product questions ^answered correctly showed a 
significant Interaction for Word Analysis scores » but no relationship with 
Total Reading scores (718; £^s « .04» range .72 to .84). The relation- 
ship with Word Analysis scores was a negative slope for higgler ability 
classes but a zero slope for lower ability classes. This result suggests 
that higher ability students did better when product questions were not 
too easy. (These questions could be answered with a single fact or label.) 

There were no other significant relationships for the difficulty 
levels of different types of questions* 

Level of errors for different types of selections . Because the 
instructional model emphasized types of selection and because some types 
of selections seemed more likely to lead to correct auswctrs (volunteering ♦ 

2'Jo 
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call 6tfts), the proportion of each type of selection that did lead to correct 

» * 

answers was examined. 

The proportion of ordered selections that led to correct answers showed* 
cui*villnear relationships with achievement (6A0; £*s • .Ol, .08, range • .67 
to .84). For both tests, these curves were of a shallow inverted U-shape#'% 

There was a positive linear relationship for the propci'-tlon of pre- 
♦selections that led to correct answers (641; £*s < .01, < .01, range « .60 
to .79). There also were significant positive linear relationships with 
achievement for the proportion of nonvblunteer selections that led to 
correct answers (642; « .03, .04, range • .61 to .76). 

Similarly, there were positive linear relationships for the proportion 
of volunteer selections that led to correct answers for Word Analysis '■ 
scores (643; £ « .05, range • .69 to .84). This result was not significant 
for Total Reading scores. There were no significant relationships with 
achievement for the proportion of call out selections that led to correct * 
answers (644). (Most call outs were correct.) 

The ranges on these variables, with the exception of call out selec- 
tions, indicate similar rates of correct answers for each. Th.c general 
pattern o^ positive relationships with achievement for higher levels of 
correct answers was not changed by separately examining the types of 
selection. 

" Process feedback . This was coded whenever the teacher gave an explana- 
tion about how an answer was figured out. There were significant curvl- 
linear relationships for the proportion of all response opportunities that 
Included pj<>_c<::«s feedback (728; £*s « < .01. < .01, range « .01 to .03). 
All of the curves were inverted U-shaped, although the curves for higher « 



20i 

-192- 



ability classes ascended more steeply before turning. The range for this 
variable was relatively restricted. It was not examined in turn inter- 
actions because it happened so seldom. For nonturn interactions* the same 
curvilinear pattern was found (729; £*s < .01, < .01* range • .01 to .04j. 

To analyse the use of process feedback in a more detailed way, dif- 
ferent types of answers were examined, 'the proportion of correct answers 
fbllowed by process feedback again' showed significant curvilinear rela- 
tionships with achievement for total and nonturn interactions (total: 783; 
£»s •\02, .01, range « .00 to .OA, nonturn: 784; £*s - .02, .02, range • 
.00 to .04). Again, these curves show the same pattern (an inverted U-shape) 
with a fairly definite positive slope leading up to a plateau and slight 
negative slope. Again, the range is restricted, indicating that process 
feedback did not follow correct answers very often. 

Correct answers were broken dowiji^into reading and nonreadiag questions, 
and there were no significant relationships (866, 867) for reading questions. 
However, when correct nonreading questions were examined, the proportion 
followed by process feedback again showed significant curvilinear rela- 
tionships with achievement (912; ^'s • .09, .04, range - .00 to .05). 
Again, the curvilinear pattern is f> positive *s lop 8 that plateaus. The 
curve for higher level groups rises more steeply before plateauing than 
that 'for lower level groups. 

« 

The curvilinear patterns did not pej?ei8t when incorrect answers were 
examined. Instead, the proportion of Incferrect answers followed by process 
feedback showed significant positive linear relationships for total response 
opportunities (797; £'s •= .01, 103, range - .00 to .05), and for nonturn. 
Interactions (798; £'s « .01, .02, range « .01 to .08). Process feedback 




occurred more often following incorrect answers than correct answers. 

When examined separately for reading questions » the proportion of 
Incorrect answers followed by process feedback showed similar positive 
linear relationships for total response opportunities (882; £*s • .Oi, .08, 

* 

range - .00 to .06), and nonturn response opportunities (883; j^*s » .02, . 
.08,. range •« .00 to .10). 

These results for process feedback "suggest that, following correct 
answers, process feedback is valuable some of the time but should not be 
overdone. It would be redundant in many cases, and it could seriously 
disrupt the pace of th^ lesson, if used too much of the time. 4lowever, 
following incorrect answers, process feedback can be an approjh^iate tech" 
Aique. The largest range was observed when only incorrect answers to 
reading questions in nonturn interactions were examined (from 0 to 10% of 
the time). Perhaps this is the mo^t appropriate time to use process feed- 
back without disrupting the pace of the lesson. 

New questions . There was a. curvilinear relationship for the propor- 
tion of all response opportunities that included new ques>tions (743; 
2's « .01, .02, range « .10 to .23). The curves are shallow inverted U*s, 
roughly parallel for both low and high groups. When the proportion of 
nonturn response opportunities that contained new questions was examined, 
there was a significant positive linear relationship (745; £*s < .oi, 
» .01, range « .10 to .19). These* rcs^jlts suggest that it is often 
desirable to follow completed response opportunities with new (typically 
related) questions, at least within the range observed. 

Because the instructional model encouraged use of sustaining feedback 
rather than terminal feedback, we were Interested in the use of new 
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question following terminal feedback (so tha*^» In effect, the student's 
Interaction with the teacher sustained* although not with a question *: 
to correct his error). There were no significant relationships found for 
the proportion of any type of terminal feedback that was followed by a 
new question (957» 958, 959). 

^ The use of a new question following correct answers was positively 
related to achievement for total response opportunities (788; 2*» ** •Ol, 
.03, range «• .13 to .24), and nonturn interactions (790; " .01, .02, 
range ~ .12 to .23). 

The use of a new question following reading turns that were completely 
correct showed curvilinear relationships with achievement (856; £*s • .06, 
.04, range « .06 to .33). These curve** show fairly steep positive slope 
up to a plateau for higher ability classes, but a shallow Inverted U for 
lower ability classes. 

When correct answers were broken down into reading and nonreadlng 
questions, there were significant curvilinear relationships for the use 
of new questions following correct reading questions for total interactions 
(871; £*s « .02, .02, range » .10 to .29), and for nonturn interactions 
(873; ^'s « .04, .04, range » .08 to .28). All of these curves showed a 
positive slope up to a plateau. There were no significant relationships 
for the proportion of correct uour£>ading questions followed by new 
questions (917) ♦ 

Ther^. were no significant f^Jndln^;s for t!io uso of now quofUions 
following incorrect answers («1U «96, 898, 9:^))- Thore also were 

no relationships with achieven/ont for the uko t>f ^nfw qitofxtlons foll<»wlnK 
reading turns that contained some firor.n (8(>0)^ or fi)r i>4V questions 
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following no response answers (841, 843). 

Swmary of results of regression analyses of dther response opportU'^ . 
nity categories . The types of questions asked, the rate of correct answers, 
and two other types of feedback not discussed in the instructional model 
were examined for relationship with achievement • Out of nine categories 
of questions^ only two showed significant results: word attack questions 
had positive relationships with achievement and jgersonal questions had 
negative relationships « The difficulty level of questions, as measured 
by the rates of correct and incorrect answers, did yield significant 
findings* A higher rate of correct responses, especially during reading 
turns, was associated with greater achievement* There were curvilinear 
relationships for some variables describing correct answers, and ail vari«^ 
ables fell within a range in which some errors were made, so these results 
suggest an optimal level of difficulty which allows for some errors rather 
than support for errorless learning. Two other types of feedback, process 
^nd now question , yielded positive relatloftships with achievement, although 
many of th.ese were curvilinear, suggesting an optimal"Uev^l» Process 
feedback was most closely related to achievement when it followed incor- 
rect answers « . New questions were most closely related to achievement 
when they followed correct answers • 
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B aJiiiyioral Con tacts 

Althoup.h not specifically discussed in the Instructional model, we 
were Intt^rested in the ways that teachers corrected misbehaviors. 

There were negative linear relationships for the proportion of total 
contacts that were behavioral contacts (1031; £ » .01, < .01, range « .09 
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to' •23)«' Teachers who spent more of their tine correcting students for 

I- 

misbehavior produced less achievement, probably because less time was 
available for academic interactions in their reading groups. Teachers at 
the high end of the scale had almost one behavioral correction for every 
three academic contacts.. 

Behaviora^ contacts were classified as occurring within t^e group 
(the teacher correcting students whom she is teaching at that time)» or 
outside the group (out-of-group students interrupt the teacher* or she 
interrupts the group lesson to deal with out-of-group students) . Each 
was analyzed separately as ^e proportion of all contacts, and revealed 
similar patterns. Both were negatively related to achievement (in-group 
behavior corrections: 1077; £ « .05, .02, ranjpe « .04 to .11, out-of- 
group contacts: 1078; £ « .01, £ < .01, range » .04 to .12). 

Each behavioral co^^tact was identified as to the type^^f student 
behavior involved, and variables were created expressing the proportion 
of all corrections related to each type of misbehavior. There werje no 
significant relationships for any of these variables, indicating that 
no one type of misbehavior was more closely related to outcome than any 
other (1102 - 1012). This was true even, when single behavior types were 
clustered together to express the proportion of behavioral corrections 
that had to do with interactive' and potentially disruptive problems, 
versus those that were noninteractive and nondisruptivc, such as day- 
dreaming (1011, 1012). 

Teacher rone t ion s to misbehav ior. The teacher reaction expressed 
'in each correction was coded as mnnagein«.>nt; (a mild, matter of ff>ct state- 
melVt to the child), wainitu* (a mo9P severe correction with evident irrita- 
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tion In the teacher *s voice), a criticism (a very harsh correction with 
or without punishment) , or nonverbal intervention Cthe teacher corrected 
the student with an expression, gesture, snap of ^e fingers, or touch). 

There were no significant relationships for the proportion of behavioral 

♦ 

contacts that included management statements (I0I5). The range for tMs 
variable (.45 to .64) indicated that management was the most common type 
of teacher correction. ' 

There was, however, a significant negative linear relationship for 
the proportion of behavioral contacts that included warnings (1016; £ < .01, 
< .01, range - .12 to .26). This-relationship might indicate that teachers 
whD used a lot of warnings d d so because they had many behavioral problems 
and/or because they were overly reactive teachers who responded too harshly 
to such problems. However, when the absolute rate per minute of warnings 
was examined, there was a significant interaction for the Woid Analysis 
test, with a negative slope for higher classes, and a positive slope for 
lower classes (428; £ » .02, range « .01 to .06). 

There were no significant relationships for the proportion of behavioral 
contacts that included criticism (1017). The range for this variable was 
from .09,^0 .22, indicating that it did occur fairly often, but was not 
the most common type of correction. 

The proportion of contacts involving nonverbal intervention showed 
significant positive relationships with Ward Analysis achievement (1018; 
2 « .04, range = .01 to .10), However, this distribution was positively 
skewed . 

These results indicate that too much use of w arning (moderate irrita- 
tion in correction) is dysfunctional, and some use of nonverbal intervention 
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is appropriate. The ranges observed suggest that teachers are most likely 

« 

to Mse management, then warning, then criticism, and then nonveTbal inter" 
vention* The more effective teachers had more nonverbal intervention and 
less warning than those who were less^effective. 

Some separate types of misbehavior were examined for the types of 
teacher response to them. The only ones that occurred with enough frequency 
to be analysed separately were those cowtidered to be Individual inappro- 
priate behaviors followed by different types of teacher reactions were ' 
similar to the overall patterns just described. That is, there were no 
significant relationships for use of management , but there was a signifi- 
cant negative relationship for warning (1026; 2*s - .01, .02, range • .12 
to .27). There were no significant relationships for criticism or non- 
verbal intervention (1027, 1028). . < 

The interruptions involving out-of-group children were examined in 
some detail to see what effect they might have had on achievement. Thes^ 
were classified as teacher-initiated (she corrected a student in the room) 
child-initiated (a student came up to the group from oul^side and 'inter- 
rupted the teacher) . Each of these categories was further divided into 
brief or long duration. » 

« 

When only behavioral corrections were consideri^, the proportion 
that was in~group rather than out-of-group was not significantly related 
to achievement (1040). However, when all teacher-initiated contacts were 
considered (this included all response opportunities, all in-group behavior 
contacts, and all out-of-group behavior, contacts that were initiated by 
tht! teacher rather than by the students), there was a significant negative 
linear relationship with achievement (1079; £'s « < .01, < .01, range » .02 

« 
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to .08). That iSt considering only those interactions over which the 

♦ 

teacher had direct contxpl, the- higher the proportion of tines that she ^ ' 
Initiated something with students outside the group, the lower the class 
achievement. This undoubtedly Is a reflection of an overall manag'.ment 
^ ability to have the rest of the class running smoothly while the teacher 
concentrates on the reading group. * 

When only child-initiated out-ofogroup contacts were examined, the 
proportion that were brief rather than long was not significantly related 
to achilevement. This also was true for the proportion of teachcr'>inltiated 
contacts that were brief . However, the absolute rate per minute of long 
teacher- initiated out-o£-group contacts showed significant interactions 
(42A; Ji*s » .03, .03, range « .01 to .05). There were negative slopes 
for highet ability classes, and slightly positive slopes for lower classes. 

The i .oportion of out-of-group contacts that were child-ini t la ted 
rather than t eacher-ini t ia ted was examined to see if one type of inter- 
ruption was less of a problem" than the other. However, there were no 

0 

significant relationships for this variable (10A3). 

Teacher reactions to out-of-group behavioral, contacts also were 

examined separately for child-initiated vs. teacher- initiated conta« ts. 

These variables reflect the general pattern rt ported earlier for teacher 

reactions. Responding to child-Initiated contacts with a warning showed 

an interaction such chat there was a positive, slope for lower ability 

students and a negative slope for higher ability students (10A7; £ » ♦0#» * 

< .Ol* range « .00 to .15). This suggests that when students approach 

« 

the teacher for either brief or long interactions, it may occasionally 
be appropriate to be severe with lower aoility students, but not higher 
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ability students. It may be that this Is a type of misbehavior that teachers 

# 

should discourage* strongly If necessary, especially in lower ability classes. 

There were no significant relationships for use of criticism In response 
to chlld->lnltlated contacts, but there was one significant positive linear 

« 

' • * ... > 

relationship with Word Analysis for the use of nonverbal Intervention 

(1049; £ • .03, range » .00 to .09). 

All teacher-lnltlated contacts were also examined for the proportion 

. ^ 

that involved each type of teacher reaction. There were no significant 
relationships for the use of management (1063), but there was a significant 
linear negative relationship for the use of warnin g (1064; £ »• .02, .02, 
range « .19 to .40). There were no significant relationships for criticism 
or for nonverbal intervention (1065, 1066) . . j 

Summary of regression' analyses for behavior con 'cts> Classes with 
higher proportions of behavior contacts had lower achleyement. Both 
contacts within the readlt^g group and those occurring outside of the 
reading group showed negative relet tionships with gain, especially contacts 
initiated by tl^e teacher herself to students outside the group. Specific 
types of student misbehavior were not differentially associated with ' 
achievement, but there were significant relationships for the types of 
teacher reactions to misbehavior. Use of warning statements (moderately 
severe corrections) showed negative relationships when expressed as 
the proportion of all behavior contacts » However, there were no signi- 
ficant findings for types of corrections which were less severe (manage - 
ment statements) or more severe (criticism ) , :ise of nonverbal corrections 
was posltivfly related to gain within a small r^rgo of occurrence. There 
• were a few suggestions that mdre frequent use of more severe correction^* 
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(waxnings) In lover ability classes aiight be related tc gre^'-er gain 
(within a restricted range of use in the first place)*' but these jrere 
not found for all variable^,, and were mostly confined to absolute rates 
ratV : than proportion variables.* 
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Chapter 5t Surena^y of Results and Revision of the Instructional Model 

The major questions asked in the First-grade Reading Group Study were? 
1) 1)td the treatment have an effect on studept achievement? 2) Did the 

♦ 

treatment have an effect on teacher behaviors? 3) What were the reXatlo^ 
' ships between teacher behaviors and student achieveAent? 

Chapters 2, 3, and 4 have addressed these questions Separately by 
presenting data for all variables. Based on the results reported, general 
answers to those questions can be offered, but tKe final evaluation of the 
experimental model requires an integration of several sets of results. 
Therefore, this chapter discusses the groups of variables, proposes modi- 
fications in the instructional model based on the results, and Identifies 
patterns of relationships that run throughout the data. 

As was discussed In Chapter 2, the adjusted class mean scores on 
reading achievement were significantly affected by treatment group member- 
ship. Therefore, other analyses were performed to determine if this effect 
could indeed be related to specific parts of the treatment. This required 
comparing the behaviors of the treatment and control teachers, as well as 
comparing other aspects of their classrooms and schools. If there were 
consistent differences in the behaviors between the treatment and control 
groups in the direction predicted, ajoA if those behaviors were related to 
achievement, and if no other factors were uncovered which also differenti- 
ated the two groups and were r^elated to achievement, then the treatment 
could be said to have influenced the learning of the students. 

Unfortunately, there are no clearcut and unqualified conclusions. 
It does «ippear that the treatment was successful in changing teacher 
behaviors, 'although not all components of the instructional model were 
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iaq;>leiaented as expected. Many of the behaviors described In the model > 
were Indeed related to achievement, and the resullts of regression analyses 
shed 8<nie llgi^t on the contextual factors lnfl«i^nclng those relationships. 
Therefore, there Is some support for concluding that the treatment did 
influence the teachers to behave In ways that, were related to achievemer* . 

In general, the major principles 'underlying the complete Instructional 
model were supported: Individual students should have opportunities to 
receive Information from the teacher and practice new skills, receiving 

* * 

feedback on their progress. However, the results suggest some additional . 
ways to achieve this In the small group setting, aiid some of the specific 
results lend support to principles not Included In the treatment Itself, 
which call8,^to question how much the treatment actually , contributed to 
the cbserved group differences In achievement. 

Of course. One possible explanation for an overall treatment effect . 
on achievement could be that a Hawthorne effect was present. That is, 
perhaps the treatment teachers were simply trying harder to teach well, 
because they knew that they should be doing better since they had received 
a special treatment* If this occurred. It could account for the relation- 
shlp^ of tiCj^eatment principles to achievement. That is, the treatment 
teachers could have used the behaviors recommended (such as ordered turns), 
but also could have tried harder in general, and therefore, achieved more. 
The specific behaviors (such as ordered turns) would « then be related to 
group differences in achievement, but would not be the causes of these 
differences* Such a Hawthorne effect may account for other differences 
between t\\Q two observed groups on measures that cannot be related directly 
to the treatment, such as content covered and level of correct answers « 
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Recent work by Good and Grouws (Note 8) indicates that gains in achievement 
my lie influenced simply by strong encouragement and knowledge of future 

« 

evaluation based on observation. Therefore, the possibility of some Hawthorne 
effect should not be ruled out in evaluating these data. . , 

However* the data describing the treatment group that was not observed 
suggests that a Hawthorne effect does not completely account for the 
achievement differences. The unobserved treatment group might be expected 
to be less subject to such expectancy effects » because they only came in 
contact with the experimenters at the beginning and end of the ^tear. 
Therefore, It was expected that they would be less aware of th« experimenter^* 
expectations than those teachers who were observed once a week and who 
knew that the treatment shjfuld help them teach better. However, the 
. treatment-unobserved group had significantly higher achievement scores 
than the control group, but was not significantly different than, the 

treatment-observed group, 'a Hawthorne effect was primarily responsible 

\ / 

for the differences in^ achievement, one would expect that the group who 
remained most aware of their role in the study and our expectations for 
them (the treata»ent-observed group) would have the highest achievement. 

What, then, accounts for the differences bet» lan the groups? On many 
(althougii not all) of the variables that were related to achievement, the 
treatment-observed group did dempnstrate different levels of the behaviors 
than the control group, „ln the direction related to greater achievement. 
Therefore, in order to evaluate the effect of tlic treatment, one must 
examine the "match" between the group comparison data and the regression 
analyses. Figure 2 sunanarlzes the key variables In this way. 

The following, sections examine each component of the Instructional 




Figure 2: 

Suromary of* major results of anaiysfts of ^roup differences 
(treatment vs. control) an<l' relationships with achievemet^t 



Principle # 



Variable 



Group . dif f erences 
in expected direc- 
tion detected: 



Relationship 
with. achieve- 
ment detected: 



J. 
1 
2 

' 3 
4 
5 
6 
7 

7 
8 

. 9 
10 
11 
12 

13&14 

15 

17 » 18, 19 

19 
20 



Use of signals in transitions no 

Efficient transitions, yes 

Appropriate teacher seating no 

Use of overviews no 

Presenting new words at beginning no 

Repeating new words before using them no 

Sufficient explanations no 

Providing opportunities for practice 

to individual students yes 

Minimizing choral responses yes 

Using ordered turns to select 

respondents * yes 

Calling on students for comments no 

« 

Minimizing volunteers . yes 

Minimizing call outs yes 

Avoiding confusing questions no 

Breaking up the group due to different 

learning rates no 

Using a student as a model no 

Use of sustaining feedb«ick to improve 
student errors and initial failures to 

respond * yes 

Minimize calling on other students. to 

cori*cct an error * yes 

Repeating correct answers no* 



no 

yes (+) 
yes (+) 
yes (+) 
no 
no 
no 

• 

yes (+) 

« 

yes (+) 

yes (+) 
no 

« 

no 

yes (4) 
no 

no 
no 

yes (+) 

no . 
no 
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Principle # 



Variable 



Group differences 
In expected direc 
tlons detected: 



Relationship 
with achieve- 
ment detected: 



20 

21 
21 
22 



Omitting feedback after correct 
answers 

Moderate use of praise 
Specific use of praise 
Specific use of criticism 



no* 
yes 
yes 
no 



. yes (+) 

yes (+) 

yes C+X 

yes (+) 



Variables not directly tied to the Instructional model: 



Group differences 
significant: 



Use of clues when presenting new 
words 


no 


yes 


(+) 


Time, spent In lessons 


no 


y§8 


(+) 


Time spent In question/answer format 


no 


yes 


(+) 


Curriculum used 


yes 


yes 


(**) 


Content covered 


yes 


yes 


<+) 


Use of word attack questions 


no 


yes 


(+) 


Success rate of students 


yes 


yes 


(+) 


Presence of behavior corrections 


yes 


. yes 


(-) 



* There were group differences, but in the unexpected direction < 
** Interaction 
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model In thejpc terms, ^tlng \§hen the difforeaces becweea the two groups 
corresponded to the regression data In a way that could account for the 
treatment group *8 superior achievement. Suggested revisions pf the ins true-' 
tional model are theu offered. In some cases, such revisions involve 
describing the desired behavior more completely in order to boost imple^ 
mentation. In other cases, the principle should be changed or eliminated. 
Other measures not directly related to the original model suggested some 
important additions. 

* 

4 , 

Getting and Maintaining the Students' Attention (Principles 1 & 2) 

The Implementation data for these principles showed some differences 
between the treatment and control groups, but most of these could not be 
attributed directly to the treatmeCT. Treatment teachers had slightly « 
more efficient transitions, but they were not using signals more often, 
as was suggested in the instructional model. 

The regression data matched the implementation data in that efficient 

transitions were related to achievement, while measures of the specific 

I 

suggestions made In the treatment were not. The time spent in 'transition, 
student attention to signals, the need for corrections of students once^ 
they were in the group, and the time taken by the teacher to get the lesson 
started were aspecjs ot transitions that were related to achievement, 
probably because they reflected overall management skills that were 
reflected in transitions • 

Implementation data on seating arrangements as discussed in Princi^ 
pie 2 showed no differences between the treatment and control groxips in 
the way the teacher positioned herself, but a slight difference in the way 
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the students positioned themselves. On the average, however, neither group 
showed high implementation of this principle. Means for teacher seating 
Indicated that the average teacher could only see 60% of the other students 
in the room, while 60% of the students could also easily see the rest of 
the room. Regression data for seating arrangements showed positive rela- 
tionships for the teacher, seating variable, suggesting that the more effec- 
tive teachers were thosfe who placed themselves to monitor a greater portion 
of the class. However, there were no significant relationships for ratings 
of studeiit seating (i.e., how many other students were visible to the 
children' in the group) . 

Therefore, we cannot conclude that the treatment teachers wer. more 
effective due to stronger implementation of the principles related to 
getting a^d maintaining student ai'ttention at the" beginning. However, the 

findings for efficiency of ttansltlons do suggest that the treatment 
J 

teachers' greater achievement gains might have been due to better manage- 
ment skills. It may be that the treatment teachers were better classroom 
managers to begin with, despite the random assignment of schools to treat- 
ments. However, it is also possible that the dispusslou of transitions 

* 

in the treatment model may have made the treatment teachers more aware 
of transitions, and this awareness may havt; rosuUod in better manaj;e- 
' mcnt of them. 

Given the results of the regression analysis, these principles in 
tho model should be revised in this way: 

— Timo spent in tranfiltion betwot-a rfadinj'. j'.iuupy should 
b«» min iml/.cd» :nu\ .u- 1 i v i t i i-.s should hv as ot fii iont as 
pOHsiblf, The teacher should rouoentrate on tfa«-hinr. 



the students to respond Immediately to her signal, so 
that corrections are not necessary. The teacher should 
make sure that she is ready to begin the lessou* once 
the students are in the group, so that she can capture 
their attention immediately and spend less time organizing 
materials and getting the students settled down. -When 
this is achieved, it will resjilt in more time available 
for content instruction. 

— The teacher should arrange the classroom and the reading 
group area so that she can see as many students as possible 

during small group instruction . 
These two principles should be illustrated with specific suggestions 
for accomplishing these goals (e.g., how to teach students to move through . 
transitions; how to monitor the rest of the class while teaching the small 
group) . 

Introducing the Lessor, and New Maiterial to the Students (Principles ^,4,5 S 6) 
There were very few differences between the treatment and control groups 
iv implementation of these principles. Treatment teachers were likely to 
present niort; new words per lesson and use more phonetic clues when presenting 
them, but these differences cannot be related to the treatment. (They may 
be due to differences in the basal series used.) Also, treatment teachers 
were more likely to dismiss their students to their seats after demonstrating 
an activity, which was unexpected. Control teachers were more likely to 
have students begin their written activities while still an the group. 

The regression data did suggest some relationships between achievement 

♦ 9 



and behaviors measured for these principles, but these relationships did 
not usually natch the differences between the treatment and control ^groups* 
Teachers who failed to give overviews produced less achievement, suggesting 
that use of overviews to begin a lesson is\a good strategy, as was suggested 
in the treatment model. None of the measures describing the content of 
overviews yielded information about vhat kind is best. There were no sign!'- 
f leant findings for the number of new words presented, although there were 
treatment effects here. There were positive relationships for achievement 
with the use of clues when new words were presented, especially for the 
use of phonetic clues.. This relationship matches the implementation data, . 
in that treatment teachers did use more phonetic clues. However, this 
cannot be attributed to the treatment, since no suggestions were made in 
the model about using clues here. It might be that focusing the treatment 
teachers or presentation of new words Increased their use of clues» and 
phonetic clues were probably the most sensible to use when presenting 
most of the words « The differences between the groups in the basal text 
used may also have accounted for this» since more treatment teachers were 
relying on a text that emphasized phonetic rules (the Economy series) « 

There were no findings in the regression data to support the principle 
suggesting that students should repeat new words whon they are given* 

There were also no findings in the regression data regarding the 
quality of demonstrations and explanations given. It may be that the 
observers were not sensitive to differences In quality* Also, no distinc-* 
tlons were made between demonstrations of new activities and familiar 
ones* Perhaps if these had been separated, a relationship would have 
bi*t»u drtocted between achievement and teacher ability to give clear 
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explanations, especially for newjor unusual activities^ 

An interesting interaction with ability was found for one of the ' 

♦ • 

variables describing the way in which teachers ch*ck student comprehension 

of explanations* Asking the students to demonstrate the activity to the 

I- 

teacher showed po^itiVe-relationships for lower ability classes, but curvi- * 
c> linear relationships in higher ability classes,* suggesting that some use 
of this technique is appropriate for all students, but that high levels of 

« 

use are less appropriate for higher ability students. This makes sense 
if one assumes that the higher ability students will understand most explana- 
tions more quickly," or will be able to question the teacher about areas of 
misunderstanding. Thereywere no relationships fpund for other ways of 
checking student comprehension of exp^-anations, although there were* differ- 
ences between tjie treatment and control groups on these measures. 

Therefore, the data for this set of principles did not suggest that 
the treatment Itself contributed to the achievement differences. Some 

« 

relationships with achievement were found, but they did not match the 
implemeiitatlon data, although one principle (use of overviews) was Supported. 

Based on the regression data, the principles In this section should 
be revised In this way: 

« 

— Use some kind of overview to begin most lessons. The 
content of the overviews will vary, depending on the 
purpose of the lessc^ and the needs and interests of 
the students. 

— When presenting new words to the students, the teacher 
should do more than say the word for the student and 
move on. Much of the time. It will be appropriate to 
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present the word to the student and offer phonetic 
clues to help the student decode th^i^rd» even if the 
teacher actually gives the wor4 to the child. 

— >The teacher should occasionally have the students 

*■ 

demonstrate to her how they will a<^complish the activity 

ii 

hefore they are allowed to work on it independently. 
This is especially important with lower ability students 
and with explanations that are detailed and possibly • 
confusing. 

The principles discussed in this section are probably more likely 
than others to be subject to context effects, and further research done • t 
with them should distinguish between the complexity of .information given 
to students in overviews and explanations, indicating whether that informa- 
tion is given when introducing a new skill or in reviewing an old one, and 
how the student will use the information (i.e., will he be working inde- 
pendently, without access to immediate feedback, or will he be working 
directly under the teacher's supervision?). 



Calling on Individual Students in the Croup (Principles 7,8,9^10,11, S 12) 

There were two sets of findings th^t demonstrated both a strong 
treatment effect and^a strong relationship with achievement for this group 
of principles: rate of individual response opportunities and selection 
of students. Also, several other variables (not discussed in the treatment 
model) were related to achievement in ways that strengthened conclusions 
about these principles. » 

The first set of findings concerned the rate at which response 
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opportunities were offerbd to th^ students. Treatment teachers had higher 
rates, and there were positive retlationshipQ with achievement » especially 
when nonturn questions were examined, separately. That is, the more often 
the student was allowed to interact orally with the teacher about reading . 
skills through single questions, the more he learned. This finding can 
be related to the data describing lesson contexts, there were positive 
relationships with achievement for the use of a context that focused on 
single questions asked by the teacher and answered by individual students, 
rather than relying mostly on oral reading or written work in the group. 
However, there were no differences between the treatment and control classes 
on these measures. (None wer^ expected, since th,e treatment did not discuss 
lesson context.) there were also significant relationships with achieve- 
menfejfor the total amount of time spent in the reading group, although 
there were also no differences between the two groups on this. 

♦ 

All of these results indicate support for greater opportunity to 
learn and practice skills in oral interaction with the teacher. Thus, 
these data add to the results of other studies suggesting that achievement 
in bas^c skills in the early grades may be optimized by maximizing active 
student engagement with academic content (Rosenshlne and Bferliner, 1978). 
Other data from this study describing content covered also suggest that 
teachers .who wish to optimize reading achievement should set aside much 
time for instruction and should use that time In as task-oriented a manner 
as possible* « 

However , the only resuH that can be tied directly to the treatment 
is the finding for rate of response opportunities. Even that was not 
defined precisely In the treatment, although teachers were encouraged to 
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offer practice opportunltle's and feedback to individual students. 

The results for choral and group responses are related to those for 
Individual response opportunities, and can be directly tied to the treat- 

♦ 

ment. The treatment teachers used fewer choral responses and allows 

fewer group call outs, and. the regression data, suggested that stich practices 

were related to achievement. However, the results also indicated that 

« 

choral responses and group call otits may mean very different things. The 
data suggest that choral responses should be minimized, but that occasional 
call ou^s by the group, especially in lower ability classes* may serve" 
useful functions. ^ 

In other teaching programs (for'^ample, the Direct Instruction model 
of Becker and Engelmann, in press), choral responses are recommended as a 
means of teaching In a small group. We do not feel that these results 
entirely contradict the recommendations of that program, however. Instead the 
data suggest that the purposes and effects of group responding in various 
contexts should be examined more closely. ^Lt may be that some teachers 
in this study were using choral responding as a substitute ^or more active, 
closely monitored individual practice. However > in the Direct Instruction 

program^ choral responses are used as a method of encouraging active 

t * 

practice^, and teachers are trained to be aware of whether or not the ^ 

student! are involved. Therefore > the critical point is not whether group 

responses are used> but rather how involved and attentive the students are. 

One might question whether the higher rate of response opportunities 

in the treatment group is actually a treatment effect. Principle 7 did 

not specifically say to the teachers to ask more questions, but it did 

indicate that it was important for individual students to receive practice 

« 

« 
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and feedback from the teacher » and therefore, choral responding should be 
minimized. ^ Lowering the rate of choral respoiodin^ could not acaount for 
the higher rate of individual response opportunities, since choral responses 
did not occur very often, even in the control^ group . Therefore, it my be 
*that the treatment teachers would have provided more 'opportunities to 
individuals to respond, even without the treatment. Agaiti, the curriculum, 
differences must be takep into account. It is possible that the series 
used by most of the treatment teachers encouraged more individual response 
opportunities by focusing on decoding skills.. Further analyses are being 
done to determine the relative effects of the treatm^tf and*1bhe basal series 

* 

on such variables as rate of response opportunities and time spent in 

« 

reading group* ^ 

♦ * 

The second important set of variables derived from Principles 7 through 
12 which showed consistency between th^ Implementation and regression data 
were the selection variables* There were very strong treatment effects 
for the use of ordered selection^ in that treatment teachers used this 
most of the time« Contif^ teach'brs did not use it often at all^ and instead 
relied on more random selection of students or student self**selection 
(volunteer or calling out) . The regression data suggested a very strong 
relationship with achievement for ordered turns » a strong negative rela-** 
tionship for the use of unsystematic teacher selaction, and negative ^rela^ 
tionships for students calling out answers* Although wa had suspected 
that strong reliance on volunteering Wopld be negatively related to achieve-^ 
ment because the more reticent students would have fewer chances to practice 
skllls> this relationship was not found « However » there were no teachers 
who relied on volunteers the majority of the time^ and it might be that 
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« larger range of behavior would denonstrate-^ome relationship with. achievement* 

»• 

Conclusions from these selection data are supported -most strongly for 
ordered turns, where all variables revealed positive, noninteractive linear 
relationships with both Measures of achi^ement . v However, caution should 
be observed in interpreting these results. Because th«re was a very strong 
treatment effect for the use of ordered turns, it nay be that they were 
highly correlated with something eljse in the treatment that also was strongly 
associated with achievement. That is, even thou^ these data come from 
an experimental study, tt\,ey are still basically correlational, and cannot 
be interpreted as' meaokt^ that ordered turns caused the higher achievement. 
However, there are some i^easons to believe that ordered selections may be 
causally related to higher\ achievement, when other good teaching practices 
are .also present. / 

First, they equalize ^he distribution of response opportunities, and 
insure that everyone gets practice and la therefore exposed to the skills ^ 

♦ r 

being learned and tested. Second, they help teacheris maintain control of 
the reading group* By reducing the frequency*of over~eager students con- 
stantly volunteering, and of other students calling out answers, the tejicher 
spendei less time trying to decide who to select or correcting students for 
call outs. Also, the teacher does not have to worry about remembering 
who has or has not answered qutesftions about a particular skill* 

Ordered turns may simply represent the most efficient way for the 
teacher to remain in control of who answers questions.^ and yet also insure 
that all students receive equal attention. The main purposes of the 
ability-based sra^ll group as we see them are to present new information 
and opportunities to the students to practice and receive feedback on 
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developing skills. Vlthln this particular context, it is not surprising 
that the advantages Offered by systetnatic selectjLon are reflected in higher 

* 

achleveioente 
« 

Revision of the principles in this section would involve deleting some 
which showed no relationship' with achievement and no differences* in imple* 
mentation: those dealing with the use of comments and confusing questions* 
It ml^ht be that the use of comments (asking another student to comment on 

* * 

an answer) could occasionally be a usefql technique, and should be suggested 
to teachers. However, systematic use cf this was not supported* by the data. 
Likewise, although it seems sensible that confusing questions should be 
avoided, the data indicated that this is not a large problem, and except 
for individual cases, should not require special emphasis in a treatment. 

The suggestion given in Principle 7 about providing feedback to every 
answer should be modlfle4 to suggest that it is Important to offer feedback 
to all answers that are not correct, and probably also to correct answers 
that are not obvious to the students. However, teachers seem abl<^ to judge 
when correct answers do not need feedback and are probably showing good 
judgment about pacing when they omit It occasionally. This may be due to 
sensitivity to pacing, or It may Indicate something about the types of 
questions that<were asked by the more effective teachers, who were more 
likely to omit feedback to correct answers. It seems futile to simply 
measure the presence or absence of feedback without examining the informa- 
tion needs at that point In time. Probably a better way to approach this 
would be to define an underlying principle that students always need to 
know when an answer is c©rroct and sometimes need to know what was correct 
about it. The teacher sRSuft remain aware of the students* needs for 
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Information about their answers, and provide tt when, necessary. 

A revised version of the model would include sijftllar suggestions regard 
Ing selection of students to respond* One amendment would be to recognise 
that teachers are not :^lkely to correct a call out and also accept It. • This 
suggestion was made in Principle 11, but was not implemented. If call outs 
were accepted for their content, they were not corrected, and vice versa. 
However, the treatment teachers did have fewer call outs and the^ regression 
data suggest that this was desirable, .Therefore, there should be more 
emphasis in the model on preventing call outs and on what they might repre~ 
sent (in terms of student enthusiasm, etc.) rather than on ways of dealing 
with them when they occur: Again, there should probably be a discussion 
of the meaning of call outs in different contexts, to make teachers aware 
that they may sometimes represent something appropriate, but that at other 
times they represent control* problems. Perhaps a useful modification of 
the model would be to suggest that teachers develop a clear signal system 
' to Indicate to students when thfey are free to shout out answers and when 
th% are not. Further guidelines could be provided to teachers about ways 
to evaluate the effects of call outs in order to make decisions about when 

♦ 

to. use them as a technique to involve the students. 

/ 

Therefore, the revised version of this section of the model would be 
as follows: 

^ — Maximize your students* opportunities to interact orally 
with you about reading skills through questions and answers. 
— ^Your questions should be dlret^ted to Individual students 
almost all of the time. When group responses (choral re- 
sponses) seem appropriate, make sure that all of the stu- 

22s 
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dents are Involved and attentive* 

4- 

--Always provide feedback to answers that are not correct. 
Feedback ordinarily should be provided when answers are 
' correct, as well, except when It is obvious that students 
know they have answered correctly. Here, It will sometimes 
be appropriate to omit feedback. . * 

— Select students to answer questlo^ systematically^ such 
as going In order around the group. This Insures that all 
students havi an opportunity to practice Important skills. 
— ^Minimize call outs from students so that you can distribute 
response opportunities as necessary. Sometimes, however, 
you may want to allow call outs to encourage Interest or 
pick up -the pace. A signal can be devised to Indicate 
to the students vt^n you will allow call outs. At other 
times, however, th^ should be discouraged. 

Dealing with Individual Learning Rates within the Group (Principles 13,14, 
15, S 16) 

This group o'' principles had poor Implementation by the treatment 
group, and the regression data did not show relationships with achievement. 
They suggested behaviors that were probably unfamiliar to most of the . 
teachers, and it seems likely that the brief explanation given in the 
treatment material was insufficient to convince the teachers to try them. 
Another possibility, of course, is that they were not appropriate for 
first-grade reading groups. Indeed, this set of suggestions was derived 
primarily from materials produced for teaching in a bilingual kindergarten 



setting where language learning is more important than reading per se. ' <r 

In revising the instructional model tot first-grade reading groups » 
these principles would not be included, at least not in their present form. 
However* work done wit^ them>n other settings (i.e., the bilingual kinder- 
garten) indicated that they ,may be useful in some situations Where there 
is more of an Emphasis on language learning. 



Responding to Anstrers that are not Correct (Principles 17, ,1$, 6 19) 

. Principles in this section yielded many variables in order to tap . 
effOQts of type of question, relative effectiveness of feedi>ack, and student . 
ability level. As might t>e expected when such a determined effort is made 
to complicate matters, the results, although generally consistent, are 

r 

complex. • ^ . 

These principles suggested that the teacher should provide feedback ' 
to incorrect answers (or failures to respond), thus discouraging call outs 
from cither students and not asking other students for the answer, and that 
whenever possible, this feedback should be sustaining * so that the original 
student had opportunities to Improve his own answer by being asked simpler 
questions. Implementation data for these principles demonstrated that, 
as predicted, treatment teachers had a higher rate of use of sustaining 
feedback, especially the category of clues . They asked other students 
for the answers fewer times, and they had fewer instances of other students 
calling out feedback. The two gi-ouiys were very similar in having the 
teacher give the correct 'answer to the student. The treatment teachers 
were slightly more effective with their sustaining feedback, in terms of 
it leading to a correct interaction with the students, although this was 
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not emphasized in the treatnent Itself* It may be that the treatment teachers 
expected more from sustaining feedback (because of the rationale given In 
the treatment and because their attention was focused on it) and therefore 

* 

were working harder to see that it was effective. 

The regression data generally matched the implementation data, and 
did suggest several ways in which the effects of different kinds of feed- 
back are moderated by context. Generally, the higher the proportion of 
sustaining feedback to terminal feedback, the greater the achievement* * 
However, all teachers, including che most eff^tlve, used both sustaining 
and terminal feedback. Analyses of more precise variables suggested that 
appropriate use of feedback cannot be defined just, by these two categories^ 
but also must include whether it meets the students* need for information 
about an answer, and whether it interrupts the pace of the lesson, these 
results are compatible with the treatment. In that teachers were encouraged 
to use their Judgment about when sustaining feedback was appropriate to a 
question and when it would fit the pace of the lesson. The data did suggest, 
however, that improvement of incorrect answers or failures to respond 
through sustaining feedback Is a desirable thing, as was emphasized in the 
treatment . 

There were many Interactions between the feedback variables and the 
mean entering ability level of the classes. For example, an interaction 
was found for call outs from other students, such that there were positive 
rcj-ationships with achievement for lower ability classes, but negative 
relationships for higher ability classes. This behavior did not occur 
very often, so these results did not indicate tliat high levels of called 
out feedback were related to achievement. The interaction is similar to 
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one found in other research (Brophy and Evertson, Note 1) and in the data 
on group call out8» and is interpreted similarly. That Xs, call outs may 
mean different things in the two different types of classes.' Within lower 
ability classes, they may represent students* enthusiasm and eagerness, 
whereas in higher ability classes, whert- lack of motivation is not as likely 
to be a problem, they may represent a control problem* ^ 

Other typ^, of feedback yielded significant main effects. The teacher's 
giving the answer was related to lower achievement, especially when it 
followed failures to respond.* (However, all teachers did this some of the 
time.) Tw types of sustaining feedback, clue and give by clue , were 
related to achievement. These results support the general conclusion that 
sustaining feedback is advantageous much of the time. Teachers need to 
help students process the information that will help them correct an error 
or see the reason for it, and giving the student the answer and going on 
to another question much of the time Is not going to accomplish this. 

We expected to find some interactions with entering ability for these 
variables, such that higher ability students would need less of the detailed 
Information offered by cluelng feedback and could more often be helped 
by the teacher giving the answer to them. However, these Interactions were 
not found, and the negative relationship for giving tho answer was similarly 
strong for both ability levels. The only interaction for ciueing feedback 
was found when examining mistakes made during oral reading turns. Here, 
In higher ability classes, it seemed hetLer for the teacher to simply prod 
the studfnt or wait for him to corrcot his mistake, rather than providinp 
clue feedback most of the time. However, in lower ability classes this 
pattern was reversed. This was interpreted as Indicatinu that lower 
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fibllity students at this grade level do» Indeed* need more information to 
correct an answer than is provided by simply repeating the question* vhereas 
higher ability students* given more time* may work through to the solution 
more often. 

However, this result might also indicate that the purpose of oral 
reading turns within higher and lower ability classes is different* If the 
students In these classes are reading at different levels* and if the higher 
ability students were reading longer passages and focusing more on compre- 
heision, then the optimal feedback might be determined by what would be 
necessary to keep the pace going. In this case* stopping to give clue feed- 
back would disrupt the pace* although it would help the student work through 
the process of sounding out a'word^ Waiting a few seconds for .the student 
to figure it out on his own might actually be a more efficient way of getting 
the word read* 

All teachers showed a tendency to give the answer to the student in 
reading turns more often than in other situations > and this probably also 
reflects pacing requirements » in that giving the answer allowed the student 
to move on without disrupting comprehension of the passage* When examined 
only in reading turn Interactions, giving the answer to the student was not 
related to achievement at all, so that the negative relationship found over- 
ail for its use may not necessarily apply within reading turns where the 
p.i' inj; requirements are so different. 

In the orlK>inal treatment manual, there was much discussion of how 
the teacher must use her own Judgment In selecting feedback strategics* 
iMst iiu* t it»ns w;»re drawn between the types of questions being asked, in 
that sotne an2iWi*rs were obviously not amenable to sustaining feedback. 
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Distinctions were also drawn between different pacing speeds, in that in 
rapid drills the teacher would be more likely to •give an answer and move 
on quickly. In levising these prin<;lples» the general rationale would 
remain tl^e same, with teachers being encouraged to use si^staining feedback 
:;s much of the time as seemed appropriate, especially when' students failed 
to respond. The discussion of appropriateness of feedback should be expanded 
slightly to consider the pacing requirements' of reading turns as well as 
drills, since reading turns were more common than drills. There shouXd 
also be a discussion of how students of different ability levels will vary 
in their dependency on the* teacher for information about their mistakes. 
In the original model, the description of the behaviors involved were 
generally adequate, since the implementation for this group of principles 
was good. Therefore, they need less substantive revision than many others > 
in the treatment model. The only major change would be to eliminate the 
discussion of asking other students for the answer* This was discouraged^ 
but the regression analyses did not show that it was uudesirable. It should 
be discussed as one type of feedback that should be evaluated in the same 
torms as the others. That is, does the student receive the necessary infor- 
mation without undesirable effects (e.g., disruption of pace» student 
embarrassment ) ? 

The results support Including the foDowing in a revised model: 
—When students answer incorrectly or fail to respond^ 
the teacher's feedback is very im:;ortant. Many options 
are ai>on to the teacher > and all will be appropriate at 
various tlm***;. Thc» ii*iih«*r nuist mako a derisioii aljout 
how to respond to the students, based on two considera-- 




tionsi a) What Information doaa the student need, and 
how will he use It? b) How will the feedback affect the 
overall pacing of the lesson, and how does that relate to 

• ♦ - 

the lesson *s objectives? 
The following princlpIciT can be used to answer these two questions: 
—Most of the time. It Is better to provide sustaining 
feedback to the student by asking simpler questions 
that lead him through the process in order ^to correct 
the answer himself, or by simply allowing him more txme 
to correct without help. When using sxjstaining feedback, 
the teacher should tailor it to the student by making 
it possible for him to answer the new question with the 
information provided. 

—Soihetimes sustaining feedback will not be appropriate, 
due to the type of question asked (it cannot be broken 
down into simpler questions) or the pace desired by the 
teacher (i.e., when students are reading a passage aloud 
for comprehension, purposes or when conducting a . fast*- 
paced drill, sustaining feedback would interrupt the pace 
necessary for the purpose of the lesson). When this is 

• t 

t 

the case* the teacher si ould provide the correct answer 

/* 

In some way* although sh*; should be careful that students 
do not come to rely on this, especlUlly If students 
frequently fail to respond* 

V n ^ 
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Responding to Correct Answers (Principle 20) 

This principle emphasised that correct answers should be acknowledged 
.and the teacher should make sure that all students heard and understood - 
them. The Instructional model suggested that teachers would occasionally 
need to repeat an answer, or have It repeated 'by the students, and %iould 
generally want to provide some kind of feedback following' correct answers* 

Neither the Implementation nor the regression data met expectations. 
The treatment teachers were actually less likely to use emphasis feedback 
(repeating or having an answer repeated) after correct anaiierst and they 
were more likely to omit feedback after correct answers. The results 
suggest that this principle may have focused the treatment teachers* 
attention en their behavior following a correct answer^ but their own 
judgment suggested a change in their behavior opposite to wWt was predicted. 

The regression data indicated that the treatment teachers were using 
good judgment. Although there were no relationships found for the use 
of emphasis feedback following correct answers t there were positive rela*» 
tionships with achievement for omission of feedback after correct answers. 
This occurred an average of less than 15% of the time> and no teachers 
were omitting feedback most of the time. Although it cannot be determined 
from the data» it may be that the correct answers that were not acknowledge j 
were apparent to the students « so that they did not need the information 
provided by teacher feedback. The teacher may have been omitting feedback 
in these cases because stopping to provide feedback might have unnecessarily 
interrupted the pace of the lesson. However, it is possible that omission 
of feedback following correct answers is as much a reflection of the type 
of questions asked, as of the teacher *s feedback style* That is, perhaps 
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the more effective teachers (who tended to-onlt feedback more often) were . 
also asking simpler questions with obviously correct answers* • 

In revising this principle, the discussi^ should include^ the basic 
premise that all s'tudetns in the group should have heard and underbtood 
the answer, but there should be less emphasis placed on repealing the 

• « 

answer. Perhaps it is more important that the teacher maintain the students 

* 

attention on the lesson, so that repeating the- answer is unnecessary. 
However, there was no evidence to indicate that repeating the answer is 
an undesirable thing to do. Therefore, it could be discussed tfith teachers 
as a useful technique to use some of the time. The principle should 
therefore be rewritten as follows: 

—Maintain the students* attention on individual responses 
so th--. they will hear correct answers when given. If the 
teacher feels that other students did not recognize the 
answers as correct, she should do something to focus their 
attention on it. 

The discussion of this principle 'of providing. feedback to all correct 
answers shuuld be less absolute. The focus should be more. on times %ihen 
it is appropriate and desirable to omit feedback following correct answers. 
As is the case with many of the principles, appropriate use Is dependent 
to a. great extent on the teacher knowing what information the students 
need In order to understand the skills being taught. 

I 

4 

Praise and Criticism (Principles 21 & 22) 

'These principles suggested that praise be used moderately and with 
discrimination. It was suggested in the treatment that both praise and 
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criticism should be very specific, so th»t students could kooir exactly 
what it was about their behavior or answers that was desirable or undesir*- 

* « 

* 

able. 

Implementation data for these principles showed that there was some 
treatment effect, but it was not strong. Treatment teachers did use less 
praise and were slightly more specific in the use of praise, >ut they 
were not specific very often. . There were no differences between the two 
groups in the l**vel of criticism offered (although Principle .22 did not 
actually suggest that there be more or less, criticism, only that it be 

♦ * 

more specific). There were no differences between the two groups for « 
specificity of <!riticism. 

The regression data match the implementation data for praise, in that 
there were generally negative relationships with achievement for praise 
and one curvilinear finding, indicating that a moderate amount of praise 
was most effective. However, these results were not consistently strong, 
and were found for only one of the test scores* There was a positive rela 

♦ * 

tionshlp with achievement found for specificity of academic praise, but 
this also was limited to one test score. 

Pral^se was not specific very often* Indeed, less than 8Z of all 
Interactions that Included praise were specific. Praise Itself, however, 
was more frequent. When nonturn Interactions were examined separately, 
the range thit Included praise was from AZ to 19X. Some teachers were 
praising one out of every five answers given by the students. For this 
variable (I.e., nontum Interactions that Included praise), relationships 
with both test scores suggested that those teachers at the high end of 
the scale (those offering praise almost 20X of the time) were achieving. 
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1686. Although it cannot be determined directly from the data, it 'makes 
sense that such frequent use of 'praise may have si^emed insincere and 
meaningless. Other research has suggested that frequent praise may Indeed 
represent very low expectations by the teacher, which are also reflected 

♦ 

in less effort to encourage good performance (Brophy and Good, 1974; 

« 

Kleinfeld, 1975; Welnstein, 1976). That is, the teacher praises work 
that Is less than the student's best, because she did not expect any bettet 
work. If such an attitude Is related to frequent use of praise« it is not 
surprising that there are negative relationships with achievement* 

There were no relationships with achievement for academic criticism. 
It was rare, occurring in less than 10% of all academic interactions. 
However, when both academic and behavioral criticism were examit.ad together, 

« 

there were significant negative relationships with achievement. < This result 
probably reflects the teachers who were overreactive and focusing too much 
attention on student misbehaviors, probably because they had poor managerial 

* ♦ 

skills. When total criticism (both academic and behavioral) was examined 
for specificity, there were positive relationships with achievement, although 
as with praise, there was little specificity (less than 10% of all criticism). 

In revising Principles 21 and 22, we would retain the emphasis on a 
moderate and discriminating use of praise, with Suggestions to be as specific 
as possible with its use. The low levels of implementation of specific 
praise, however, suggest that the treatment itself should be more precise, 
expanding this discussion to include more examples, as was done with the 
section on feedback. 

* The discussion of criticism in the model should probably be expanded to 
include more emphasis on preventive management, and to help teachers focus 
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on the meaning of extremely negative cycles of critical reactions, to students, 
tikewise, the discussion of specificity (i.e., pointing out to the students 

ft 

what they should be doing instead of the nisbehavior or incorrect answer) 

should be expanded to provide more examples. 

Therefore, the revised principles would read: 

— Praise should be used in moderation and should be. as 
specific as possible about what is being praised. The 
teacher should be careful not to overdo nonspecific 
praise, especially if she finds herself responding auto- 
matically with praise, instead of responding to the answer 
with more informative feedback. 

--Criticism may be appropriate sometimes, although . 
the te«^cher should be as specific as possible about 

'what desired alternatives are.. Criticism of students* 
behaviors may sometimes result in failure cycles in which 
the criticism is not effective. Teachers should concen- 
trate more on preventing misbehaviors (by supplying enough 
work to do easily, by consistently en^'orclng expectations 
in clear informative ways, etc.), and remain aware of 
the effects of criticism when they do offer it. If it 
does not have the desired effect (changing the students* 

•behavior) > then the teacher should seek other solutions* 

Time Usa^e ^ 

Several variables were analya^ed to see how teachers used their reading 
group time« Only one of these (rate of questions) was related to the 
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treatment, so few differences were expected between the treatment and 
control groups. Some differences we^e apparent, however, but nost did not 
relate to achlevonent. * 

The treatment teachers did Vot «dlf f er fr<» the control teachers In 

the amount of time spent In the small group lesson, or In the way that 

... I * 

time was used In different contexts. However, these measures were related 
to achievement. The more time .sp^t In the lesson, and especially the more 
time spent In a format designed t^v^^res^nt questions to Individual students 
to«an8wer orally, the more the class as a whole achieve. I^ls may be 

* ^ * 

because there was more public dononstratlon of skills. Even though each 

* . *' 

Student did not answer each question, he heard It* 

The treatment teachers did dlf fe4r from the control group In one way 
that was reflected In the achievement data: more reading groups were seen 
each morning (although there were no dlfferences^^in^^th^^ time spent 

with each group). This might mean that the treatment teachers were more 
closely matching their Instruction to ability group level, but further 
analyses are necessary to determine this. That Is, more homogeneous groups 
(which would result in more groups in most classrooms) may be better. 
However, until such analyses are done, this finding should not be the 
basis for a principle. Data discussed in the next section demonstrated 
that large classes had higher achievement. It may be that the larger 
classes also had the roost groups, and that the number of groups reflects 
this, rather than careful matching of students by ability level. Indeed, 
there were no relationships with achievement for average group size. 

There also were no relationships with achievement for the number of 
activities assigned to students during the reading group lesson. This 

♦ 
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may not accurately reflect the amount of followup work given to thli students 
to do, since the teacher nay have made other assignments before the students 
were seen in the group* Therefore* this variable may simply reflect teacher 
Style in giving assignments, rather than the amount of seatwork assigned to 
the students. .Treatment teachers did assign more activities in the 'group 
than did control teachers, but this difference was not reflected in. the 
achievement data* 

* ♦ 

Therefore, the time usage data suggest some principles that should be 
added to the instructional model, but they do not indicate that the treat-* 
ment group and control group differed in ways that accounted for the treat- 
ment effect on achievement* 

The following principles should be added to the model, based on these 

data: 

— ^Reading groups should be between 25 and 30 minutes long* 

♦ 

The length will depend on the attention level of the student, 
which will vary by ability level and probably also by the 
time of the year and the context of the lesson* 
— Up to one half of th^ lesson time should be spent in a 
format that allqws for teacher questions to individual 
students, without the use of materials* Oral reading 
and work in workbooks will sometimes be appropriate, but 
should not be used «So the exclusion of the questioning 
--^ . |forroat« ' 

\ • 

Curricul u m Used and Contont Covorcd 

* Tlu?re were differences between th^ control and trt^atment groups on 
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the basal series used w>st often and in use of other coaoBercial »«t«rials. 
There were also differences in the rate at which students aoved through 
the material, with the treatment reading groups moving. at a slightly 
faster pace. Some of these differences were also reflected in the analysis 
with achievement scores, sjiiggesting that part of the treatment effect may 
have been due to curriculum and other factors not directly related to the 
treatment . 

Although fchejre were large differences between the treatment and control 
groups on the choice of principal basal, there were no main effects to 
sugg^t that one series was uniformly better than another. However, there 
was a significant it;teraction suggesting that one series. Economy, was 
positively .-related to achievement for reading groups^ that started with 
higher levels of readiness, but was negatively related for lower ability 
groups. Since more treatment than control reading groups used the Economy 
series, it is possible that at l^st part of the overall treatment effect 
(i.e., greater adj,usted achievement In treatment classroomsj was due to 
greater use of the Economy series. However, the absence of a main effect, 
and the slightly negative relationship with achievement in lower ability 
reading groups prevents clear conclusions about the effects of the con- 
founding of curriculum and treatment. However, the Economy series did 
place greater emphasis on phonetic rules than the other series, and other 
research (Chall, 1967) has indicated that ;)honics are Important in begin- 
ning reading instruction. 

It is easier to interpret the data describing the amount of content 
covered. The teachers who exposed their reading groups to more of the 
basal curriculum had higher adjusted achievement scores. The slopes for 
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higher and lower ability groups were significantly different, although 
overall th^re was a positive relationship* These results suggest that it 
is important for the teacher to encourage the students to cover as such 
ttaterial as possible, and that a faster pace nay be relatively ittportant 
for higher ability groups. This is comparable to other research done with 
elementary students (Brophy and Evertson, 1976; Good, Grouws, and Beckerman, 
1978; Brophy and Evertson, Note 1). 

The treatment did not discuss how fast content should be covert. 
However, there were weakly significant differences between the treatment 
and control reading groups on these measures. Since these analyses were 
conducted with an N of 66, the use of the .10 level of significance is nat 
as justified as it was with the analyses using an H of 20. However, the 
trend toward a higher level of significance should be noted. It is possible 
that the treatment teachers pushed their students somewhat faster because 
they were aware that their performance was being monitored and. because they 
were expected to outperform the control group (I.e., there may have been 
a Hawthorne effect that was not directly related to the content of the 
treatment). It might also be that some components of the treatment made 
It easier for the teachers to move somewhat faster through the books..- 
However, In Interpreting the overall treatment effect (i.e., the treatment 
groups achieving more than the control groups) the data on content coverage 
must be considered. 

In revising the instructional model, one additional component should 
be an emphasis on presenting materials to the stiu?'»nts to maximize their 
exposure to the skills. The data on time uiiagc suRfiost that one way to 
do this would be to extend the reading group time. The suggestions made 
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* 1 * 

in the original treatment model* at least those that shoved relationships 
with achievement, are more likely to be useful when they occur in a setting 
that makes it possible to pressnt-^iere to the students and insure that 
they are attending to the information. 

Therefore, the 'following principle should be added: 

ooStudents should be encouraged to move quickly through 
the curriculum if teachers desire to maximize achievement 
scores e The rate at which they are exposed to the 
curriculum will vary, depending on the ability level of 
the students. However, rapid coverage of the curriculum 
must include learning of the skills, not page Coverage 
per se. 

Other Jtespqnse Opportunity Categories 

In addition to the parts of response opportunities that were most^ 
emphasized in the treatment (selection and feedback), the coding system 
included descriptions of types of questions, level of answers, and some 

« 

additional categories of, feedback* 

Types of questions e There were no differences between the treatment 
and control groups on the types of questions asked* Both groups asked 
mostly word recognition question about 55% of the time^ with the second 
mo3t frequent type of question being comprehension questions .(about 12% 
of all questions on the average)* 

There were some relationships with achievement for two categories of 
questions that did not occur frequently* Word attack questions (the 
students was asked about a letter or sound within a word) were positively 
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related to achievenent. Teachers who asked more word attack questions used 
them about 15Z of the time, compared to an average of lOX for all teachers. 
It may be that use of such questions was also related to the curriculum 
used» since one series (Economy) had a stronger emphasis ou phonetics* 
However, use of that series showed an interaction with initial ability 
to affect achievement, rather than the linear effect shown for word attack 
questions. Also, there were no differences between the two j^joups on 
frequency of word attack questions, even though there w^re differences in 
use of that basal series. Therefore, at this point, question type cannot 
be atttibuted directly to the choice of basal. (Further analyses may detect 
such an influence.) 

There were negative relationships for personal questions, although 
these did not occur often (the mean was 2%), and the result was probably 
due to a few teachers with outlying scores. It seems unliKely that using 
personal questions such a small percentage of the time would relate to 
achievement, although the results do suggest that this should not be 
,oyerdone . 

Since there were no differences between the control and treatment 
groups on the question variables, the treatment effect cannot be related 
to these two findings. However, revisions of the model should probably 
include a discussion of word at tack questionn. In that they may help the 
student understand better how to apply phonetic rules when reading a word. 
Earlier reading research (Chall, 1967) has suggestfd that phonics Instruc- 
tion should be included in early reading Instruction, and this type of 
question is liktily to bt» a reflection t>t f?uch an omphaKlH. 

Level of answer* There won dlt'forences between the two groups for 
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relative frequency of correct answers, and these differences were reflected 
In the regression data. Therefore, the overall treatment effect may have 



been partially due to this factor, although this cannot be related directly 

1 

to the treatment, except for no response answer The treatment group had 



a lower rate of failures to respond, and this can be related to ttie emphasis 
in the treatment on eliciting a response to every v ''Stlon. Likewise, the 
regression data supported this part of the treatment: fewer failures to 



Higher levels of correct answers were related to greater achievement. 



no support for errorless learning. These results were clearest when reading 
turns were examlntid separately. Indicating that oral reading should be 



based on material that Is easier for the student than questions asked out 
of turn. This makes sense, if the purpose of oral reading Is to practice 
skills other than word calling, such as reading with expression and for 
comprehension. If the level of the material is too difficult, then more 
attention must be paid to correcting single words at the expense of the 
1 '«nproht>nsion process. However, in a diffei'cnt setting, such as a question- 
answer exchange with tie teacher, errors are apparently not a hindrance 
to the purpose of the lesson^ and indeed may be important for diagnosis 
about the skills Involved^ 

These results may be taken together with those describing appropriate 
fetnihark to errors in order to define two contexts in which errors have 
dlltereut meanings an! require different responses from the teacher, both 
In planulnj. .nut in ooulu- ting the lesson. Oral reading may be viewed more , 
J>to.^'ly as an exercisi» in ai>plying several separate skills for a larger 




respond were related to greater achievements 



although within a range in which some, errors occurred* That is, there va8 
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purpose, such as comprehension, and to build fluency and speed j^hile ^Ing 
so. That is, the purpose is one of coordinating several separate skills 
that need to be almost automatie foir the coordination to Uke place. It 
makes sense, then, for this to occur at a level where the separate skills 
(in this case, word calling) are not so difficult for'tEe chi3.d that he 
cannot coordinate them. It also makes sense for the teacher to provide 
feedback to errors in a manner that does not interfere with the larger 
purpose of the exercise. The feedback data did not suggest an optimal 
response to error* in turns as strongly as it did for nonturn response 
opportunities. Perhaps in reading turns (or any situation where the 
purpose is to coordinate the application of several skills) the type 
of feedback is less important than the initial control of the error level 
(i.e., the teacher should make 8ui?fe that the separate skills can be .used 
easily in that exercise) . 

This situation is very different from one where the focus Is on 
learning separate skills (such as applying a single pnonctic rule to 
decode a word). In the First-grade Study, nonturn response opportunities 
arc examples of this: for nonturn response opportunities, there were no 
significant findings for error rate, while there were more important 
relationships for the type of foodhack tollowinj'. errors. Perhaps, then, 
in IcKsons In which the purpose Is to hulld skills b efore having to 
coordinate them, the error rate is less important than what is done with 
the errors (i.e., the type of feedback offered by the teacher) so long 
as It is not too hl^jh. 

There are no apparent reasiwus why thf tttatmont i;roup had higher 
rates of correct answers than the control group, since this cannot be 
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directly related to the treatment. As was discussed in' the section on 
content coverage* the treatment teachers also noved their students through 
the basal materials slightly faster* and therefore can be' described as 
more challenging; even though the success rate vas hi^er. They were 
apparently better at designing instruction that balanced the right amounts 
of challenge and success that would allow for easy progress. This might 
have been due to pretreatment differences, or it might have been due to 
a Hawthorne effect in that the teachers were "inspired" to be better teachers. 
The general tone of the treatment materials could have contributed to this, 
but the specific behaviors in the model are not directly relevant to the 
findings for error rate and challenge. In any case, a revised version of 
the model should Include a discussion of error rate and how it is important. 

Other types of feedback . The two additional types of feedback that 
were examined yielded significant relationships with achievement,' although 
there were no group differences. Process feedback, in the form of an expla- 
nation about how to get the answer, was an appropriate thing to do, although 
it was not used extensively. It seemed especially useful after incorrect 
answers. This can be related indirectly to the treatment, in that the 
discussion of sustaining feedback in the instructional model emphasized 
the students* understanding of the process necessary to correct an answer. 

Therefore, additional information should be included in the part of 
the model describing feedback to Incorrect answers about offering explana- 
tions occasioniilly when the students have not applied the process correctly. 

Also, placing now questions to the same student who correctly answered 
the previous om* showed positive relationships with achievement, especially 
after correct answers. Althouf.h they were not coded as such, most new 
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questions nffre related to the previous questions, so that they represent 
a kind of sustaining feedback, although not for the purpose of correcting 
an error. Instead, they may serve the purpose of extending a line of thought 
through a series of questions to the same child. There wete curvilinear 
findings for some of the variablec describing new questions, which indicate 
•that it should not be overdone, probably because staying too long with one 
student mav mean losing the attention of the others. 

Therefore, revisions of the model based on the results of these «ther 
categories of response opportunity variables would include: 

— Include some questions that focus on %fcrd attack skills, 
up to about 15Z of the time. Be careful not to overdo 
questions about personal experiences at the expense of 
skill**related questions. 

"rBeattentlve to the number of errors that students are 
making and how that affects the purpose of the particular 
lesson. If students are practicing skills that they should 
know well, but are working on using them rapidly and smoothly,-' 
then the material should be relatively simple. When students 
are working on new skills and receiving frequent feedback 
from the teacher, the difficulty level is not as important, 
although most questions should elicit correct answers. When 
errors do occur, apply the principles describing feedback 
to incorrect answers. 

— In general, feedback to any type of answer that emphasizes 
the process to solution or the steps in a sequence will be 
appropriate much of the time. The principles describing 
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ftuAtalning feedback to errors are based on this premise* . 
Additional feedback techniques that are similar in purpose 
and which may be used on occasion are process feedback, in 
which the teacher explains to the students how to get an 
answer, and asking a new question to the same student, to 
extend a line of questioning to its logical conelusion, 

« ♦ 

Behavior Contacts 

This group of variables showed some dif f ere *ce8 between the treatment 
and control groups, and also some relationships with 'achievement that match 
those differences, although the correspondence is not perfect. 

Treatment teachers * ad slightly fewer corrections than did control 
teachers, although the results were marginally significant in many cases. 
Differences were especially apparent for interruptions to correct a student 
out of the group: control teachers did this more. It is j^ssible to relate 
this to the treatment, since Principle 2 emphasized sitting to monitor the 
rest of the class, although general management of the entire classrocxn was 
not emphasized as such in the treatment model. Here again, there are dif- 
ferences between the two groups that are open to several Interpretations: 
there might be a treatment effect, there might be a Hawthorne .effect, or 
the treatment* teachers might have been better managers to start with. 

The frequency of behavior contacts, both within the group and to stu- 
dents in the classroom, was negatively related to achievement, supporting 
the contention that classes in which behavior problems are prevented will 
achieve more. (Genorally, the absence of behavior contacts indicates the 
absence of problems, although it is of course possible for a teacher to 
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ignore misbehavior, in which case no* behavior contacts would have been 
record^ e) 

' ' ■* * # > 

The type of aisbehavlor was not related in atiy way to achievementt 

even when examined as cluster variables of disruptive vs. nond'isryptive 

behavior. Most behaviors leading to correction within the group were 

nondisruptive (i.e»» they involved single students being inattentive, 

* 

# • • • 

misusing materials, etc.) . 

The results for teacher reactions to misbehavior did not reveal dif-* ' 
ferences between the treatment and control groups^ although there were 
some relations with achievement « Teacher reactions could be rated on^a 
scale of severity^ from nonverbal intervention^ to a management statement, 
to a warning statement, to criticism* It might be expected that more 
severe statcanents would be negatively related to achievement, since^.they * 
might represent management problems. This was truie for warnings , where 
negative relationships were found. However, there were no significant 
findings for criticism alone, although this did not occur very often. 
Teachers who responded to misbehaviors most of- the time with Irritation 
(which would have been coded as warning ) were probably those vlth the 
most problems In managing the classroom and/or who overreacted to students, 

a 

which cduld dilute their credibility « However, these differences in teacher 
reactions were not reflected in the group differences as were the propor- 
tions of misbehaviors « (Since ^die treatment did not address this topic « 
except to recommend that criticism be specific, no differences were expected.) 

There weie not extensive data collected on overall cluBsroom management 
since this was not cmphasisted in the modoU However, these data suggest 
that It is important, since the teacher must be able to cdncentrate on 
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instructing the students in th|B snail grbup» and this involves maintaining 
their attention as well as preventing interruptions from out 'of the group. 
Also, it Is likely that overall reading achievement depends not only on 
the group instruction, but also on the independent work done while other 
groups are being taught. Therefore, the teacher who establishes an atmo* 
sphere in^hich more can be accomplished by students working on their own 
while she is with a group is likely to maximize their practice of skills 
(and hence, learning) in two different ways: through engagement in seatwork 
and effective instruction 'in the group. 

The revision of a principle describing use of criticism has alfeady 
been discussed (see page 230) and Is further supported by these data. 

» 

Another important principle can be derived from the data describing 

* • * 

behavioral contacts • 

—Stay aware of how ms^y of your contacts are behavioral 
in nature, and work to prevent misbehaviors so that more 

a 

of your attention may be focused on the lesson. There are two 
places where this is important: with the students in the 
group, and with students at their seats. Minimize interrup- 
tions of the group lesson to deal with out-of-group matters. 
Unfortunately, this is easier said than done, and to be effeccive 
such a principle would have to be illustrated with specific suggestions 
for improving management. Although ttie First-grade Study did not yield 
such suggestions, the work of Kounin (1970) Is a valuable source, and 
other research presently being conducted by the authors ma> provide relevant 
information here (Evcrtson and Anderson, Note 9; Anderson and Evcrtson, 
Note 10). • ^ 
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Discussion 

' These results suggest a useful teaching style for snail group Instruc* 

m 

. tlpn in the early elementary grades. Many points In the Instructional nodel' 
were substantiated, and nan^ of the other variables yielded additional Infor- 

* 'aatlon. Taken together, the data presented a fairly cohesive picture of 
the "effective first-grade reading group teacher.** Some of th^ principles 
enbodled in the results may be applicable in other primary-level classes 
for other subjects aiid other formats, but many of the specific techniques 
that exemplify the principles may be less appropriajte in a different context 
(e.g., large group instruction, math instruction, third graders). For 
example, the principle of providing many practice opportunities to students^ 
who are learning basic tool skills Is probably important in many settings, 
but the use of ordered turns to insure systematic selection of students 
may be less appropriate with large groups or with a lesson where* the content 

♦ 

is more predictable, especially with older students who might indeed "tune 
out** until their turn. 

Even though the appropriateness of specific techniques will change 
with the context, the value of the general principles is not negated. 
Indeed, a useful approach to organizing research to use In teacher education 
may be to Identify the important major principles, such as those discussed 
below, and then to describe for teachers the specific techniques and strat- 
egies that will embody those principles in different settings. The 
instructional model used in this study was an attempt to do Just that: 

to begin with the principle that the teacher must manage the entire group 

/ \ 

while at the sarac time (and, in fact, in or^ler to) provide attention to J 
Individuals within the group* Another underlying principle related to 



this was that the teacher oust elicit responses fv<m students to allow then 
to practice skills being taught and receive immediate feedback before being 
allowed to work on their own. The specific suggestions for aeconplishlng 
this were designed to be appropriate to first-grade reading groups, and . 
many of the results of the study can be used to make them even more appro- 
priate in that setting. (For example, the original model did not eoq^hasize 
different pacing requirements of reading turns as opposed to questions asked 
outside of turns, and yet the results suggest that this is an important 

r 

factor to consider in defining appropriate error rate and feedback.) 

Patterns in 'the data suggest that the following principles are valuable 
and that their implementation (in a manner appropriate to the specific 
setting) will foster student achievement: 

1) As other research has found (Rosenshine atid Berliner, 1978^; 
Ck>od, et al., 1978), students achieve more when they were given greater 
opportunity to learn. In this study, the more effective teachers spent 
more time with the group and covered more content as a result. However, 
no teacher met with reading groups an inordinately long time; for first 
graders that would have been inappropriate. However, the teachers whose 
students achieved more met with their groups for 30 minutes as opposed to 
20 minutes a day. Although measures of seatwork were not taken in this 
study, it Is likely that the careful patching of follow-up work is also 
important, with sufficient tim# being spent by the student to practice 
skills to the point ot fluency. There were indications that classes in 
which students at their seats worked quietly and Independently also achieved 
more, which does suggest that tlme-on-task in follow-up activities is 
also Important. 
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2) It Is Important, that students bs given opportunities to practice 
skills so that the teacher nay monitor their understanding, provide feedback, 
and adjust her teaching accordingly. Accomplishing this goal In first-*, 
grade reading groups Involved several distinct skills. Preventing mlsbe- 
havlor that could distract the teacher and other students was Important, 

as was efficient use of time within the group. (For example, teachers 

who were ready to start the lesson Immediately, without ne^lng to orgaMse 

materials or to correct students, had higher scores.) Students should be 

* 

selected ^o respond In an efficient way; lii order to Insure that everyone 
gets a chance to practice. Within first-grade reading groups, ordered 
selection was often an effective technique to accomplish this purpose. 
At least In the getting we studied. It was Important that most (although 
not all) of the questions asked to the students result.cd In correct angers. 
For students at this age who are learning a skill that, mu; become auto^' 
matlc, a low rate of errors may be necessary to supply enough correct 
practice of the skills in order to internalize them. For students at 
different ages and with different objectives, more or less difficult material 
may be appropriate. Indeed, some research has indicated that the optimal 
difficulty level may depend on several factors* including learner aptitude 

* 

and motivation (Brophy ajjd Evertson, 1976; Crawford, Note 11). 

3) The teacher should provide as much information as is appropriate 
about the structure of the skills involved, rather than focusing only on 
memorized rules or labels. Positive results for several specific variables 
supported this principle: a) using overviews (which presumably help to 
set the stage for the steps to follow); b) using sustaining feedback after 
errors (which accomplishes two goals— the student receives practice at 



successfully deriving the snswer, end the sequentisl steps to^the solution 
ere nede obvious when the tescher gives the clues to help breek down the 
question); c) providing process feedback (so that an explanation of the 
steps is provided by the teacher) $ d) occasionally asking new questions 
(that generally are related to the preceding one, so that the saae student 
is following up on his or her earlier answers); e) being specific when 
offering praise and criticism (high-lighting behaviors of interest). 

Teachers who use such techniques pone of the time may be helping 
the students focus on the relevant aspects of the problem solving process* 
However, the data indicate that these techniques are often not appropriate 
when they are overused and when they could interrupt the pace of the lesson 
(with these data, especially with oral reading turns). When the pace is 
broken, the immediate objective of the lesson may be lost (as, for example, 
when the purpose is to comprehend the passage) , ^or the other students* 
attention may wander, in which case time-consuming behavior problems may 
result. 'Such techniques as listed above wil^ probably be more or less 
appropriate in ajiy setting, depending on how easily the teacher can work 
them Into the lesson and how important it is that students see the sequence 
behind solutions. 

A) Underlying all of the other principles, and making it possible 
to Implement them In Instruction, must be good overall classroom management. 
In the well-managed classroom, .students follow efficient routines for 
accomplishing dally tasks, and there Is a calm, pleasant environment in 
which all students opay work without distraction. This means that the 
teaohfi prevents behavior problems, and that the students concentrate on 
the acaderai.c .tasks. In this study, evidence of good management In the 
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more effective teachers* cfasses vas found for such variables' as transition 
tine and feirer betiavior corrections « Indeed^ those teachers had Inplenented 
an effective management structure that made It possible to accomplish other 
goals, such as ^extended reading groups, more *con tent covered, and greater 
student participation. Much Information Is being generated currently about 
how teachers mayv. establish smoothly running classrooms* The growing body 
of research now makes possible t-o attempt .to change teacher managerial 
behaviors through*' efforts such as the present study (Kounln, 1970; Brophy 
and -Putnam, Ih press; Evertson and Anderson, Note 9^ Anderson and Evertson, 
Note 10). 

The findings from the First-grade Study are In line vlth the concept 
of 'Mlrect Instruction*' espoused by Rosenshlne and others (1976; Rosenshlne 
and Berliner, 1978) . These data provide specific Information about 'strat** 
egles for Implementing direct Instruction In one setting — reading groups 
• . In first grade. Research conducted in other settings will help to distinguish 
further the specific requirements of the setting from the general prl'nplples 
tlMTt' apply to a large population of learners and objectives. Through this 
kind of systematic approach to Identifying process-product relationships, 
and then through experimental efforts such as the First-grade Study and 

others discussed in the next section, the knowledge base about effective 
teaching will become a practical and valid source of information and , 
direction for the training and continued education of teachers. 
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Chapter 6: Suftgestiona for Future Experlnental Studies of Teaching 

Tj^e First-grade Study was successful in meeting nany of its objectives. 
Teachers in the treatnent group did use parts of the instructional model* 
and at least part of the achievement differences can be related to the model. 
As described in Chapter 5» the process-outcome relationships supported many 
of the instructional principles around which the treatment was built. 

On a ^broader level* we believe that the results of this study support 
the efficacy of process-product research in the classroom* and the utility 
of experimental studies that attempt to modify teachers* behavior while 
substantiating earlier research/^^tSd^ngs. Through such efforts, classroom 
researchers are able to see findings translated into practice while validating 
the original results and refining prescriptive principles to include the 
^'exceptions to the rule." 

In order for validation and refinement to occur, the process of applying 
research findings must be conducted hnd evaluated carefully* This means 
that an experimental paradigm must be developed for use by classroom 
researchers chat provides both rigor and relevance* Although an experimental 
apprdach is certainly not new to educational researchers, .most experimental 
work with instructional variables has relied on artificial settings or 
controls within classrooms that isolated variables of interest* Such an 
approach allows experimental' rigor, but lacks the flavor of the real-world 
setting of the classroom^ The results are not generallzable, and therefore 
are not usable by practitioners • 

However, using the natural setting of the classroom means that an 
experimenter must deal with miiny real -world oonstralnts outside his or 
her control. Because of the complexity of a classroom, an experimental 
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study that does not control or account for important factors nay, raiss more 

♦ 

questions than it, answers.- 

This, then, io the dlXenma facing the classroom researcher who. wishes 
to conduct experimental studies: thex« must be a compromise between rigor 
and relevance. The experimenter must maintain the "ecological Validity'* 
of the setting and also maintain control of or account for factors that 
affect teacher. behaviors and student outcome. 

The prospect of Juggling these two priorities is not as grim as it 
might seem at first glance. At' this point, three large-scale studies have 
been reasonably successful in attaining this compromise and influeiu:ing 
both teacher behaviors and student outcomes. (In addition to the First-- 
grade. Study, see Good and Grouws, Note '8, and the work of Gage, Crawford, 
and associates. Note 1^.) By drawing on the experiences of these researchers, 
'several suggestions can be made about experimental design. Brophy (Note 13) 
made some of these' as reviewed below; and other suggestions became apparent 
while reviewing the data from the First-grade Study. Therefore, the following 
sectian.s offer a retrospective view of how to design an experimental study 
of effective teaching. t 

Hrantai ntng the Kool ogic al Vajidlty i>X iJ}£-..r\l*'*:l*'J.<?*^."l .'l^liL^^JL^ir^.^lf-'ltil?. JLt^ji^ 
The purpose of an experimental stuvly in a classroom netting is to influ- 
ence teachers to aMopt the behaviors and pr* mi pies defined in a treatment. 
Generally, the treatment is a compilation of earlier research on effective 
teaching and typically suggest strategies for dealing with routine situa- 
tions and i!t.fiHlon.s. Tills focu.'i oi\ tlu- tvpical rtujui r<'ftt'nt of classroom 
life is not fortuitous. Research on effective teaching has demonstrated 



-252- 



that strategies for dealing with **tv plcal'* situations differentiate more 
and less effective teachers * Examples are; arranging students for Instruc- 
tion, sequencing and pacing lessons, selecting students to answer, responding 
to student answers, scheduling instructional activities, and creating and 
maintaining order. Research has demonstrated that teachers* performance 
of such tasks has effects on student outcomes. Since teachers expend most 
of their time and energy In dally, routine decisions and Usks, efforts at 
Improving their performance in these areas is likely to have payoff by 
affecting those student outcomes most closely associated with the teaching 
t asks . 

The Content of the Treatment 

Therefore, one of the most important considerations in the design of 
experimental study Is the content of the treatment— what it is that the 
teacher Is supposed to do. If teachers are to Implement the suggestions 
in the course of their regular Instruction, the treatment must convince 
th«u'. to di, so as effectlvel: as possible. Doyle and Ponder (1977) suggested 
thai thi' "oract it al It.y ethic" determines whether or not teachers will effec- 
tive iv us.' advicf. Practicality depends on three qualities: It must be opera 
tion.il (easily translated into behavior); it must be congruent with th 
t4a(her's own role del in It Ion; and it must be efficient In terms of the 
t.-.i<her's iost and time. Th«;je three suggestions Imply that a treatment 
will hv i mp I te»l roost easily when it is specific in terms routine 
tr.i.h.T luh.jviors, ami when It provides a rationale that effectively relates 
ih«' avuns to tUo tea«hfr's goals of instructing the students. Also, 
tl,, .,!..»*•. » . ;aist i.'t mak* rxteunlvf deuiand.s on the teacher's time and 
•i'.«'> v, t .»( l.Mst n<»nr t5..it aif not <»)mi)ensa t ed lor Ir sumo way. (Of 
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course, an adequate rationale that convinces teachers of the validity of 
the treatment often will be sufficient to justify extra effort on their 
part.) 

Is is possible to influence more drastic change in teachers* behaviors, 
but it seems obvious that treatments that do not offer extensive support 
and compensation in terms of time and energy will not lead to adoption of 
novel or complex behaviors. Therefore, suggestions that are difficult to 
Incorporate into the teacher's dally routine are not likely to be implemented 
easily. However, as the present study and the other experimental classroom 
studies have demonstrated, changes in student outcome may be influenced by 
treatments that are limired to familiar teaching tasks and that focus on 
the principles defining successful strategies for fulfilling those tasks^ 
Such treatments offer more hope for effecting Improvements in instruction 
and learning than more radical innovations that da not have an adequate 
research basis (such as changing to individualized assignments for each 
child or movement to open classrooms » for ex<implc). 

In summary of this first pointy the content of a successful treatment 
must reflect the teacher's understanding of the daily demands of the class- 
room in order for him or her to implement it thoroughly* Evaluation of 
a treatment depends on its being implemented^ and so the classroom researcher 
mu develop trcsitments that are likely to he Implemented if the hypotheses 
are to be tested. The research base on teaching effectiveness contains 
immy data that meet this requirement. Studies based on these data have 
been successful in Influencinf; student oulH.oine through teacher utillziition 
of the sii>u;est ions about routiiu^ tea< hin>; tasks. 



t 

Clustering of Specific Suggeations 

However, if we require that a treatment be operational and reasonable 
in tern»8 of routine classroom tasks, another problem immediately arises. 
The treatment must be specific enough to allow translation into actual .be- 
havlor, but there are Inherent difficulties with very specific advice. 
Specific suggestions must be imbedded within larger principles, since no 
isolated behavior can be appropriate all of the time. Hoyever, it is not 
possible or desirable to list all possible situations and the variables 
defining appropriateness in them. ♦ 

Therefore, a more reasonable approach to treatment design is to Identify 
general principles of effective Instruction and to cluster specific strat- 
egies under each. The specific strategies then serve as examples of the 
larger principle, and may themselves be organized around familiar teaching 
tasks and settings. When treatments are communicated in this way, the 
suggestions about particular techniques are imbedded in contexts and supported 
by rationales that can be discussed in common sense terms. 

The following lists suggest categories that might be useful in organizing 
a treatment. Included are general principles of effective instruction that 
are supported by research; settings and contexts in which teachers function, 
and which may require different techniques according to the demands of the 
Betting; and the teaching tasks that are regularly performed in almost any 
sotting. Specific suggestions about techniques (such as use of ordered 
turns and sustaining feedback) can be organised by teaching tasks, with 
thoir appropriate use being a function of the setting demands and constraints. 

Tlu' raLionalf umlorlying . thei r use it; providt d by the larger principle. 

1 

Tlie following', lists arc not intended to be oomploto, but only to servo as 
J -255- 



examples. There are, of course, other frameworks for discussing classroom 
activities and teaching strategies. For another example, see Good and 
Power (1976), 

Principles of Effective Instruction 

1. Achievement of content will depend on t^Jie learner's engaged 
time on tasks related to that content* 

la. Students need sufficient opportunities to practice components of 
complex skills and receive feedback on their performance. 

2. In order for a teacher to be an effective instructor, there 

♦ 

must be good classroom management that prevents many problems 
|and minimizes distractions and interruptions of task-related 
activities. 

Settings and Contexts in which Teaching Tasks are Performed 
Settings which teachers may choose: 

1. Arrangement of students (whole-class, small-group, individual 

* 

students working with the teacher, individual students working 
independently) . 

2. Nature of group (members very similar or dissimilar in abilities 
and backgrounds) . 

3. Lessons with different objectives (e.g., presentation of new 
material vs. practice of new material vs. review of old material 
learning of facts and labels vs. learning skills that require 
coordination and Integration of facts and principles). 

Sett ings which arc n ot ti«u al_Ty_ the teac her : 

A. Student characteristics (classes with students who are unusually 

Hit 
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low or high in ability and readiness skills » motivation). 
5* Class sise (large vs. saall). 

6. Time of year (beginning of year vs. later in year). 

7. Time of day (morning vs. afternoon). 

^ 8. Type of classroom (large vs. small, open vs. self-contained). 
. Teaching Tasks ^ v 

1. Arranging students for instruction, scheduling instructional ac- 

e 

tivities, starting and ending transitions between activities. 

2. Explaining new content, assigning work, selection of student 
activities for practice of new content. <' 

3. Selecting students to answer questions, asking questions, respond- 

♦ ♦ 

ing tc student answers. 

A. Establishing and presenting rules and procedures, correcting 
misbehaviors, monitoring student behavior.. 

It is probably not possible (or desirable) to create treatments that 
include suggestions under all or even several combinations' of categories, 
unless the treatment program is to be a long-term effort (such as a sequence 
of skills presented during the years of internship and induction into 
teaching, or an ongoing inservice program) . Even if a treatment addresses 
only a few combinations of principles, settings, and tasks, an overall 
framework is valuable because it lends necessary perspective to an examina- 
tion of the separate components of effective teaching. 

As an example of how such categories could be used to cluster points 
in a treatment, consider the suggestions in the First-grade Study treatment 
about selection and feedback techniques, 

PRINCIPLE: Students need sufficient opportunities to practice 
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conponents of conplex skills and receive feedback on 
their perfomance* 

I 

? •* 

The teacher is responsible for presenting nev phonetics 
rules to first-grade students* The students have 
been placed in a small group. The teacher's purposes 
are to present the new ryles ^nd to determine that 
the students can appl^ it with the words she will 
use in the lesson. 

* 

In order to determine that the students have learned 
the rule» the teacher will ask than questions and 
^correct them if they oake errors. 

# 

SUGGESTED TECHNIQUE: Selection. Select students 
by going around the group in order. . This will insure 
that there is equal opportunity for practice* and it 
will help control problems with call outs and over-^ 
enthusiastic students dominating the action. 
CAUTION : Be careful that the students are not 
"tuning out" when it is not their turn. If this 
occurs, then the overall objective of maximizing 
individual attention to and practice with the skills 
is not being met. 

SUGGESTED TECHNIQUE: ? pcilback to incorrett answers. 

« 

Help the child derive the correct answer himself hy 
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* * 

asking « series of questions thst sinplify the problem 
and focus the chil4 on the jequence to follow* If • 
this ir not successful, give the child the answer and 
move on. Occasionally, ^describe the sequence that 
4» must be followed tty derive th«u answer* 

CAUTION : Be careful that the. attention of other 
students is not lost because of -too such time spent 
in working with one student* I)on*t let the overall 
pace suffer* Also be careful thix" the simplified 
questions do not become "pointless pumping**, tt^ich 
embarratis the student, thus defeating the purpose of 
providing successful practice with the skill* 
Obviously, when the purpose of the lesson or the setting is very 
different, the tasks will remain the same, although the techniques suggested 
above will be appropriate less often* For example, if the teacher chose 
to present a fast-paced drill to check for rapid recosnition of sight 
vocabulary words, then frequent use of sustaining feedback would disrupt 
the pace. When students are reading aloud for the purpose of story com-* 
prehension. istaining feedback would again be Inappropriate much of the 
time, because the continuity of the passage would be lost while the teacher 
and student orked on a single word. If the use of ordered turns resulted 
In less attention than desired, the teacher might want to vary the seJec- 
tlon techniques. The immediate objectives are to distribute practice op- 
portunities fairly, and minimize problems with over-enthuslastlc students 
who might *'upstaRe'* more reticent students who also need to interact with 
the teacher. Many teachers have found that ordered turns are useful in 



achieving these objective* In this setting, but other types of selection 
mayjtulflll the same purposes. 

The purpose of presenting suggestions In this way Is to help teachers ^ 
choose among alternative strategies according to a rationale that defines 
appropriateness. That Is, the purpose of "treating" teachers Is not to 
force them to use a specific technique every time It is possible, but 
Instead to optimize ^use of several techniques or strategies— using them 
when appropriate and avoiding their use when Inappropriate. Training 
teachers to make such decisions* requires a^ conceptual framework with which 
they may examine their classroom tasks along with a rationale that explains 
why certain strategies are or are not effective in various settings. 

N 

The Implications of this for treatment design are that specific sug- 
gestions must be placed within a meaningful framework. This is an ImporUnt 
part of meeting the first objective of classroom experimental design: 
maintaining ecological validity. Teachers dally make thousands of deci- 
sions about the basks listed above and no treatment, no matter how thorough, 
will repiace the teacher's use of his or her own best judgment. 

Maintaining Experimental Control in a classroom Setting 
Although the most difficult part of designing an experimental program 
will be the development of the treatment, it is equally important to set 

« 

up the study to maintain experimental control. Otherwise, the content of 
the treatment can not be evaluated. In the traditional sense, "experimental 
control" Implies .elimination of any contaminating or modifying Influences, 
80 that the treatment is the only possible explanation for differences 
between experimental and control Rroups. It Is not possible to maintain 
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control in this'senae In classi^m studies. Therefore, It Is Important to. 
establish as much control as possible through initial selection of subjects 
and matching of groups, and then to closely monitor other factors that 
may have important effects on outcomes* In these vats, control is exerted 
cither through initial assignment or with statistical techniques. Examples ^ 
of influential factors that should be controlled arc given in the points 
below, which discuss some procedures that should be considered by classroom 
researchers who conduct experimental studies* 
*• 1, Information on classroom processes and characteristics should be 
collected before the treatment is applied. In t^is way,' one may Insure 
that treatment and control groups are equivalent ii^ important ways before 
the treatment is introduced. Measurement of preexisting differences may 
allow formation Jf equivalent treatment groups, especially if a larger 
initial sample Is available than will be used in the actual data collection. 
Some of the dimensions on which classes Will differ and which have been 

% 

t 

sho*m to influence student outcome are student ability level and background, 
teacher managerial effectiveness, sthool policies on allocation of time, 
curriculum and ntaterials, and pacing of content. 

« 

These pretreatment measures of the treatment and control groups 
were not taken in the First-grade Study. Consequently, some of the group 
differences on classroom process scores could not be explained. This 
meant that many questions were left unanswered about possible expectancy 

r 

effects and preexisting differences, and therefore, the full Impact of 
the treatment could not be determined. 

2. Data should be collected to describe the actual level of Imple- 
mentation of behaviors and principles described in the treatment in both 

-69 

-261- 



the treatment and control groups* Other research haa demonstrated that the 
effects of an Innovation may be most easily explained by measuring the . 
actual implementation* rather than by assuming differences between the 
treatment and control groups (Hall and Loucks, 19 Z7). Not all treatment 
teachers will lfq>lement to the same degree, and 'some control teachers 
will demonstrate high natural levels of use of the techniques or principles 
being examined. This latter possibility is especially likely vhen the 
treatment is based on studies of effective teachers. Some teachers in a 
. control group will already be using strategies that are associated with 
effective teaching. If the treatment is to be fully evaluated, then the 
actual extent of use by all teachers must be known. 

Researchers shoui^d also examine alternative strategies to those 
described ih the treatment, and should measure other factors that might 
influence outcome, a& described under the first point above. Even if 
these were measured at the beginning of the study in order to form equi- 
valent groups, it .is important to note changes and developtaent over time. 
(For example, management strategies that are effective at the beginning 
of the year may not be equally effective later in the year.) Also, 
some Important variables can only be evaluated at the end of the study 
or school year, such as total amount of content covcrGd. 

3. Mcisures of short- term outcomes should also be taken. In this 
way, short-term effects of the treatment may be detected. This will be 
important^ If the treatment has an effect that is different from that 
expected by the researcher. For example, in the First-grade Study, we 
suggested that transitions could be made more effective by using standard 
signals to notify the students. ~ We found that roost teachers, including 
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control teachers', did this, and so there was no group difference In Inple- 

* 

mentation of that prlt ipXe. Neither was there a relationship with out- 
come due to the restricted variance. (This .did not* indicate that the 
principle was invalid, but that it represented a very common behavior.) 
However, there were differences between the groups for the efficiency of 
transitions "^wlth the treatment group having shorter, smoother ones.) 
Since there were no measures of preexisting differences, we can not rule 
out the possibility that the treatment teachers had smoother transitions 
to begin with. However, an alternatNe explanation is that the treatment 
may have caused the teachers to focus on their transitions and work harder 
to make them more efficient, even though the strategies given in the 
treatment were obviously not ones that loade a difference* Bovevett the 
short-term outcome measure (efficiency of transitions) » provided support 
for an alternative explanation of treatment effects: Increasing awareness' 
of need leads to Improved behavior* regardless of specific suggesti^onse 

Another advantage of measuring short-term outcomes Is that their 
relationship to long-term outcomes (such as student achievement) will 
make it clearer why the long-term outcomes are related to the specific 
teacher behaviors, (that presumably led to the short-term outcomes) « Also* 
by Including immediate effects of teacher behaviors, the researcher may 
be better able to distinguish true effects of treatment content from 
Hawthorne effects (discussed in the next point) that might influence 
long-term outcomes. 

4. Tlierc is always the possibility that treatment teachers will . 
outperform those in a control group simply because of the special atten- 
tion and/or the expectations of better performance communicated to them 

« 
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<e.g*, **Ve think that this treatment will make you a better teacher**)* 
Therefore, any apparent treatment effect must be related to the actual 
content of the treatment, raxher than to heightened expectations for success 
with the accompanying extra effort to fulfill the prophecy. Otherwise » 

! » 

the principles in the treatment have not really been tested, and the pos-> 
Sibility of Hawthorne or expectancy effects must be considered. 

However, each of the experimental studies have utilised designs that 
allowed the researchers to sort out the effects of treatment content from 
other factors, although none of the studies excluded all possible factors. 
Good and Grouws (Note 8) tried to heighten an expectancy effect by informing 
his control group that their performance would be evaluated after a few' , 
months, at which time they would be given feedback along with the treatment 
that was supplied to the other teftchers. Although the student achievement 
in this group was improved, there was a greater change in classes where 
teachers had been given the specific treatment. It was concluded that 
the treatment had a positive effect that could be distinguished from the 
effects of the encouragement given the control grpup. Gage, Crawford, 
and associates (Note 12) utilized two treatment groups with differing levels 
of information provided to them. The minimal group received the written 
information and one presentation *by the experimenters (similar to the 
First-grade Stuoy's tre«»tment), and the maximal treatment group received 
feedback and extra encouragement. Differences between these two treat- 
ment groups can be interpreted as effects of treatment strength. In the 
First-grade Study, two treatment groups were also utilized to ascertain 
the effects ot observation on outcome when a treatment was given. It 
was expected that the observed group would follow the treatment model 



w>r« closely and might try harder to do well because of the frequent ob- 
servation* (This design would have been more effective if a comparable 
unobserved-*control group had also been Included for examination of student 
outcomes . ) 

♦ 

Although It has not been utilized, there is another design that could 
serve to separate Hawthorne from content of treatment effects. This would 
include two treatments, focusing on different but important aspects of 
teaching. Each group would receive the same amount of information regarding 
its own treatment and the same expectations for success. Each would be 

• * 

observed to determine implementation of its own treatment, as well as 
behavior in other aspects of teaching. If the tr^^ent content was truly 
responsible for changes in behavior and outcomes, th^ the two groups would 
differ for those behaviors emphasized in their particular treatments. 
For example,. one treatment could focus on reading group management, while 
another focused on managing whole class lessons. In the first treatment^ 
one would expect to find improved teaching in ''reading groups, but not in 
whole class instruction unless the treatment was having a more generalized 
•effect. In the second group, the most evident changes in behavior should 
be In the area of whole class lessons. However, If both groups showed 
Improvement In several areas of teaching, and the teachers were not neces- 
sarily stronger in the area specified by their treatment, then one could 
conclude that Hawchorne or expectancy effects may have been operating. 
All additi lal advantage of this design would be the opportunity to examine 
generalized use of specific suggestions in other settings. 

In somiuary, by utiliiing <it»tii^u»:; *-haL vary the fXpectationK convcyyd 
and the -xtuount and type of information given to the teachers ♦ it may be 
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possible tcrseparate the effects of actual treatment content from other 
effects on teacher performance. An additional advantage of such designs 
is that future decisions can be made on the basis of cost-effectiveness. 
For example, if a minimal treatment is as effective as a more extensive 
(and expensive) treatment in leading to a desired outcome, then the minimal 
treatment could be more easily exported to other users, such as staff 
developers, teacher educators, etc. 

5, It is also desirable to determine any effects of teacher charac- 

« 

teristics and ability. It is possible, and indeed likely, that one level 
of treatment may be effective with one teacher and not with another because 
of the teachers* experience, aptitude, and entering skills. Although no 
attempts were made to measure such teachor traits In the First-grade Study, 
the other two studies included such measures, and both found that teacher 
characteristics were important predictors of student outcome, either in 
interaction »jith or independent of the treatment. 

6. It is also important to consider setting characteristics. As was 
discussed in the first section of this chapter, the content of the treat- 
ment will be valid only as long as it recognlzos the many contexts in which 
teachers must act. These setting variables *tnust be considered ^n evaluating 
the implementation and effects of a treatment. Kor example, in the First- 
grade Study, there were important differences in imp! fnumtnt ion of certain 
strategies depending in the kind of lesson being tauKht—whethor it was 

a question-answer 'sesscn, a lesson involving writing in workbuoks or work- 
sheets, or a lesson involving oral reading. Although the treatment did 
not mention ihe different requirements t>f these typen of lossons, the 
teachers utilized the principles differently in thftu. In ronny cases, 

-266- 



when implementation scores were examined, there were significant context- 
treatment Interactions: the treatment group was different from the control 
j,..roui) In one lesson context but not in another (Anderson, et al. Note 5). 
nif.se interacti<ms were sensible: generally the treatment teachers did 
not utilize a technique that would have been inappropriate for the pacing 
requiroimnts the setting, although tht. /ould use that technique more 
than the control teachers in a setting in which it was appropriate and 
u.iiful. It is important to note that, although some contextual distinc- 
tions wf-ro built Into the treatnent (especially about types of feedback), 
loMfum furm;it was not. However, the observation Instrui^ent included much 
tnf .nr.jiiup not clearlv ; inked to the treatment in the hopes that other key 
f t<»rs woiilu be -ome obvious. In this case, lesson context emerged as an 
, {.<»rt.nl oonsldprat ioTi, especially the difference between reading turns 
.Ki t <;-.:"st i oij : askeu i»ut of turn. 

tn.vi.ujsly. it is difficult to plan and conduct a study that includes 
.-.11 ^.1 aln.vi- su<w.<stions. However, Uie points discussed should be 

.;.nNia. I. 1 in (itHigninr. and evaluating a treatment, both in terms of its 
t..!..; t-. oi; ti ... h«T Inliaviors as wvl 1 as on shori.- and long-term student 

Hi. 1 I t t'.i-.uJr of rlassr-nnn test-arch has pnvlded a body of infornm- 
ti •:. th.ti n! it ;><>ssi'>le to t rratf »«'Levant tr<'atraent models ttiat can 

j.,. ,, » !,v t.-.irh.rs. More ^^opllist ii att-d ways > ornanlzlnn and analyzing 

. . . .'-t., iufJiKiiui* Hittltipie re^.t •'sh1'»i» t e<-ltniques , nuike it 

t , .... .::::n«- :: .lus •: i mu i t atuMHi*. eiif.ts on i- lassrooms. By taking 
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advantage of knowledge in each of theae areas, classroom researchers who 
are determined to see their results translated into practice can do so 
through treatments and experimental designs characterized hy the points 
'described above. Such designs > along with continued descriptive and cor- 
relational research, will yield a more complete picture of what works 
in classrooms, when it works, why It works, and how to make It happen. 



--26a- 



Reference Notes 

1. Brophy, J., & Evertson, C. The Texas teacher effectiveness project : 
Presentation of non-linear relationships and sucamary discuaslon e 

Austin, Texas: University of Texas. Research and Development Center , 
for Teacher Education, 197A. (ERIC ED 099 345) S 

2. Brophy^ J.. Anderson, L.^ Greenhalgh. C. Ogden, J.. & Sellg. H. 
An instructional roodel for first grade reading groups (Report No. 
4043). Austin, Texas* University of Texas, Research and Development 
Center for Teacher Education, 1976. 

3. Medley, D. M. T eacher competence and teacher eCfecttvoness ; A 
review of process-product research . Washington, D. C: American 
Association of Colleges for Teacher Education, 1977. - 

4. Brophy* J., Mahaffey, L., Greenhalgh, C, Ogden, J. & Sellg. H. 
Coding system for the first grade reading f^roup study (Report No. 
4013). Austin. Texas: University of Texas. Research and Development 
Center fo aacher Education. 1976. 

5. Anderson. L.. Morgan, R., Evertson. C. 6 Brophy. J. Context effects 
and^ Btah tj i ^^Jl[_i^Cll'^!lJ^£^yj^PT^ "^^^^ study of first 
M?-4£ reaAU^^. Jii'5U»I?J?. (Rt'pon NV-. < 091) . Austin. Texas: University 
of Texas, Research and Develop v't Cent ;r for Teacher Education. 1978. 

6. Veldmaj . D., & Lii»sley. T. Ptct^ rams JHI and CURVE. Special purpose 
program using_ PR1ME_ l ibra r^ /ou^^^ .fl'^^L i>?MlM.r.?. JJ_1?.3jC 
mod-'ls. Av'^ in* Texas: University of Texas» Research and Development 
Center for ''t^ather F.duration» 1977. 




-269- 



7. Hartln, J., Anderson, L., & Vcldman, D, A wethodolo^ical approach to 
the unit of analysis problem in classroon research (?aper In progress), 
Austin, Texas: University of Texas, Research and Development Center 
for Teacher Education. 

8. Good, T. L., & Grouvo, D. Experimental study of mathaaati-cs instruc- 
t ion in elementary schools . Paper presented at the annual meeting 

of the American Educational Research Association, Toronto, 1378. 

9. Evertson, CM,, & Anderson, L. M, Interim progress report : The 
classroom organization study (Report No. 6002). Austin, Texas: 
University of Texas, Research and Development Center for Teafcher 
Education, 1978. 

10. Anderson, L, M,, & Evertson, C, M. Classroom organization at the 
beginning of school : Two case studies (Report No, 6003), Austin, 
Texas: Untversity of Texas, Research and Development Center for 
Teacher Education, 1978. 

U, Crawford, J, Relat ionships between grade p oint avera ge^ response 
roode^ difficul ty level, and J earning (Report No. 4021), Austin, 
Texas: University of Texas, Research and D<*vclopment Center for 
Teacher Education, 1975, 

1 2 . An^_*L?«£*' ^ J lit'nJL 9Ii IS^SPSM !^.. ^SSS 'ilV.? ^ and parent-assi sted instruc- 
tlou in the thji^_£^radc, Stanford, California: Stanford University, 
Center for Educational Research, Program on Teaching Effectiveness, 
1978, 

13. Brop]iy» J. I.raJ.ni-".ii .t^t'iifJVJJ^. J" V^i*<■'JA'^^*Jl^^^.* JiL^l-'LUilll?. Jlf lill?-*- 
• to nonUu<'ari and ( o.it ext. effeots. Paper pres«n^ted at the annual 

nieetiiu; of the American Educational Research Association, '"ew York, 
1977, 

ER4.C ' -270- 



Referancds 

* 

Attsubel, D. P. The psychology of raeantngful verbal learning * New York: 

Grune and Stratton» 1963. 
Becker, U., & Engelmann, S. The direct Instruction model. In R. Rhine (Ed.)» 

Encouraging change in Aner lea's schools : A decade of experimentation . 

New York: Academic Press, in press. 
Blank, M. Teaching learning in the preschool : A dialogue approach . 

Columbus, Ohio: Charles E. Merrill, 1973. 
Blank, M., & Solomon, F. A tutorial language program to develop abstract 

thinking In socially disadvantaged preschool children. Child Development , 

« 

1968, ^, 377-389. 

Blocm, B. Human characteristics and school learning . New York, New York: 
McGraw Hill, 1976. 

Borlch, G. D. (Ed.). The ippralsal of teaching ; Concepts and processes . 
Reading, Massachusetts: Addison-Wesley, 1977. 

Brophy, J., & Evcrfson, C. Lear ning from teacidng : A developmental per- 
spective . Boston, Massachusetts: Allyn and Bacon, Inc., 1976. 

Brcphy, J., & Good, T. Teacher-student relationships : Courses and con- 
sequenccs. New York; Holt, Rlnehart and Winston, 1974. 

Brophy » J., i Putnam, 0, Classroom management in the elementary grades: 
A literature review. In D. Duko (Ed.), Classroom management : Sevcnty- 
ci}^hth y.earbopk of j1he NatjU)nal Soc iety for the Study of EducjiU^n. 
Chicago, Illinois: University of Chicago PreJ»s, in press. 

ChalU J. Learning to read; The i^r cat debate New Ydrk: McC raw-Hill, 
1967. 




-271- 



Doyle* W., & Ponder, G. The practicality ethic in teacher deciaion*aiaking* 

InterchanfeC t 1977 » 8, X«12, 
Dunkin, M. J., & Biddlc, B. J. The study of teaching . N<»v York: Holt, 

Rinebart and Winston, 1974. 
Durost, W. N,, Bixler, H. H., Wrightstone, J. W., Prescott, G.A., & Balow, 

I. a. Metropolitan Achievement Tc8t8« Primary 1 (teacher^s directions) ; 

Forms F« G. and H « New York, New York Harcourt, Brace, Jovanovlch, 

Inc., 1970. 

Good. T., & Power, C. h »igning successful classroom environments for 

different types of students. > Curriculum Studies . 1976, 8, 45r60. 
Good, T. L., Grouws, D. A., i Beckerman, T. M. Curriculum pacing* Some 

empirical data in methematics. Curriculum Studies , in pr^ss. 
Groisser, P. How to use the fine art of questioning . New York. New York: 

Teachers* Practical Press, 196A. 
Hall, G. E., & Loucks, S. A developmental model for determining whether 

the treatmen*^ is actually Implemented. American Educational Research 

Journal , 1977, 14, 263-276. 
Hlldreth, G. H., McGauvran, M. E., & Griffiths, N. L. Metropolitan Readiness 

Tests : Forms A and B . New jfork. New York: Harcourt, Brace and World, 

Inc., 1969. 

Klelnfeld, J. Effective teachors of. Eskimo and Indian students. School 

Review, 1975. 83, 301-344. 
Kounln, J. S. D iscipline and group tnan agiw nt In ola«sro<>m8. New York: 

« 

Holt, Riuehaxt and Winston, 1970. 
Loughlin, R. On questioning. Educat luteal Forum, 1961, ,25, 481-482. 

-272- 



Rosensliine, B. V. Classroom instruction. In H. L. Gage (Ed.), The psychology 

of teaching methods: Seventy-fifth yearbook of the National Society for 

the Study of Education (Part I). Chicago, Illinois: University of 

Chicago Press, 1976. 
Rosenshine* B. V., & Berliner, D. C. Academic engaged time. British Journal 

of Teacher Education , 1978, 4, 3-16. \ 
Rosenshine, B. V., & Furst, N. The use of direct QbservatidJi^a study 

teaching. In R. Travers (Ed.), Second handbook of research on teaching . 

Chicago, Illinois: Rand McNally, 1973. 
Southwest Educational Development Laboratory. Bilingual kindergart en progra.u. 

inservice manual (Vol. I). Austin, Texas: National Educational Laboratory 

Publishers, Inc., 1973* . 
Ward, J. H., 6 Jennings, E. Introduction to lin^r models . Englewood 

Cliffs, New Jersey: Prentice Hall, 1973. \ 

♦ • 

Weinstein, R. Reading group membership in first irade: Teacher behaviors 
and pupil experience over time. Journal of Educational Psychology , 1976, 
68. 103-116. 



ERIC 



-273- 



Appendix A 

AN INSTRUCTIONAL MODEL FOR FIRST GRADE READING GROUPS 
To th© teachers: 

This Is a description of a system for small group Instruction of 
young children (In this case for first graders In reading groups.) It does 
not discuss content or materials, but It provides guidelines for teacher 
management of reading group Instruction. It Is hoped tnal the systematic 
use of these principles will Improve the planning and conduct of reading 
group sessions and benefit the children. A major underlying rationale for 
the system Is mat each child should receive as much Individualized Instruc- 
!^-tlon as Is possible In a group setting. 

The principles discussed In the following pages flow from both exper- 
ience and research Involving teachers and young children In small groups. 
By combining them Into an organized system to be used In the classroom, 
much more Information can be gained about how to best teach small groups of 
young chl Idren. 

The purposes r>f this project are to bring these principles together Into 
a workable system and to teach teachers to use them If they are not already 
doing so. (Tou may recognize many of the principles as techniques which yo 
already use.) After asking you to Incorporate those suggestions Into your 
teaching, we will examine the results In order to further ovjiuato Ihe sys.^em 
and the principles. These flndlnns then could bo used In teacher education 
and teacher In^ervlce programs If they show that certain techniques make a dl 
ence In chlldren*s learning. 

You probably will find that many of the principles are moro applicable 
at one tl*no than another, dopendlnn upon which children you are teach! nci and 
what kind of lesson you are presenting. We have tried to provide a general 



overvlow that can be adapted to the many different lessons and types of 
children with which the first grade reading teacher must deaU There Is 
a special emphasis on dealing with shy. Impulsive, and Inattentive children 
and problems such as wrong answers and fal lures to respond. It Is hoped 

« 

J ihat dealing with such situations In the suggested ways will make reading 

a more pleasant and productive experience for both the teacher and the children. 

Your role In the study Is central, because application of these principles 
Involves teacher Judgment based upon knowledge of Individual children's needs 
as well as a feel for the group's needs* Specific examples have been provided 
but are not meant to serve as absolute prescriptions. Rather, we ask that 
the teacher learn the general principles, and then use them according to her 
best Judgment about the situation and the children Involved. 

Please read the material and study It until you are comfortable with It 
and feel that you could conduct a reading group accordingly. A meeting will 
be scheduled at-*, our school to discuss any questions and comments. There will 
be a short test administered at the end of the meeting to assure understand- 
ing of the principles. Any areas of misunderstanding that show up on the test 
will be discussed again, so that both you as a teacher and we as researchers 
can reach mutual satisfaction and agreement about procedures. 
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INtiODUCTION 

the Instruct tonal modet Is based on two general principles concerning 

« 

children's learning In small groups: 

!• It Is desirable to have a balance between a«) an efficient group 
structure In which the pace Is rapid enough to maintain Interest and attention, 
and b«) a group structure which helps the teacher to make sure that learning 
Is taking place for every^ chl ld» 

♦ 

2* It also Is desirable that children learn to respond to every teachei 
question, but without feeling anxious about having to make a response^ 

Accomplishing either of these goals requires teacher Judgment at many 
points \jn the lesson. How fast should questions be paced to keep attentl«i 
and yet not lose anyone? How long can you wait for a response from an Individual 
without losing the attention of the rest of the group? When should you end a 
child's response opportunity If he might know the answer but seems afraid to 
say anything? How long should a chl Id be urgod to respond before such encour- 
agement creates embarrassment and anxiety? 

Specific answers to these questions cannot be prepared In advance, since 
the situation Is different for every child and every question. However, the 
system of principles outlined below can bo used as a framework within which 
the teacher, who knows the children, can make decisions. 

The principles are presented below in a brief list. In the next section 
they are discussed I « greater detail, along with the rationales and background 
Information related to them. The system Is divided Int . two major components: 
I) organization and mangemont; and 2) teacher responses to children's answers. 

In order to avoid confusion of pronouns, "she" will be used to refer to 
the toachor and "he" wl 1 1 refer to the student, 
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OVERVIEW OF THE PRINCIPLES 



!♦ 0RGAN12ATI0N A N D MANAGEfCNT ^ • 

GETTING THE CHILOREN»S ATTENTION 

1. The teacher gets overyone's attention before starting the lesson. 

2. The children sit with their backs to the rest of the class while the 
teacher faces the class. 

INTRDDUCING THE LESSON 

3. The teacher Introduces the lesson with a brief overview. 

4. The teacher presents new words clearly. 

5. After presenting new words, the teacher has the children repeat them. 

6. A demonstration of explanation precedes the children's attempts to 
do the work. 

CALLING ON CHILDREN 

7. The teacher should work with ono chlK* at a time, so that everyone Is 
checked and receives feedback. 

8. The teacher should call on children In order rather than randomly. 

9. Occasionally the teacher should question a child about another child's 
response (to keep everyone alert). 

10. The teacher should mInlmUc calllnp on volunfeers. 

11. The teacher should discourage call outs and should emphasize that each 
child Is responsible for the question asked of him. 

12. The teacher should avoid rhetorical questions, answering her own 
questions, or repeating questions. These confuse the children. 
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MEETING INDIVIpUAL LEARNING NEEDS WITHIN THE GROUP 
13. At some point, Ihe teacher must dec 4e If the whole group cen meet the 
lesson's objectives; If she decides they can, she should hold the group 
together, making sure thct ever/one masters each step before moving on to 
the next step* 

|4« If the teacher decides that everyone cannot meet the objective, the 
students who can do so should be taught through to the ':ad and then 
dismissed, so that the teacher can spe'^d more time with thi other chl Idren, 
J 5. An exception to the above occurs when the teacher wants to use a 
student who has mastered the objective as e ' for the others. Here, she 
may retain one or more such students In the group In order to carry on a 
dialogue. 

16. If some of the children do not succeed In meeting the objectives before 
lesson time Is up, arrangements should be made for extra tutorial help. 

It. RFSPflNniNfi TO rHtLDREN*S A^^S\CRS■ 

The teacher's feedback to children's answers depends on I) the type of 
question (whether It requires memory or reasoning), D the pace of question- 
ing (whether rapid for drill or slower for more thoughtful questions), and 
5) the child's answer (correct. Incorrect, *'l don't know," or no response). 

WHEN THE CHILD DOES NOT RESPOND 

17. After asking a question, the teacher waits for the child to respond 
and also sees that other chl Idren wait and do not call out answers. 
During rapid pacing, she waits a few seconds and gives the answer. During 
the more slowly paced parts of the lesson, the teacher should wait for 

an answer as long as she tools that the child Is thinking and will answer. 
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but not so long as to oiabarass the cht Id or lose the other chl IdrenU 
attention. 

n 

' If the child does not respond withtn a reasonable ttine, the taacher 
should Indicate that sane response Is expectad by probing (**0o you knoM?**)* 
She should then simplify (ste 119) according to the type of question. 

WHEN THE CHILD'S ANSWER IS INCORRECT 

18. The teacher should Indicate that the answer Is wrong, and then follow 
simplification procedures outlined below for the two types of questions. 

SIMPLIFICATION PROCEDURES 

19. The appropriate simplification procedure Is determined by the type of 
question. 

a. . If the question deals with factual knowledge that cannot be 

reasoned out, the teacher should give the answer to the chl Id 
and then move on. 

b. If the question Is one that the child could reason out with 
help, the teacher should provide clues or simplify the question. 
If the clues still do not help the child, he should be given 

the answer. The teacher should never ask anotjier chl id to supply 
the answer. 

WHEN THE a^ILD IS CORRECT 

20. The teacher should acknowledge the correctness, and make sure that 
everyone else heard and understood the answer. ^ 

PRAIfE AND CRITICISM 

21. Praise Is Important but should not be used Indiscriminately. Praise 
thinking and effort more than just getting the answer, and make praise as 
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specific and Individual as possible* 

22* Criticism should also be as specific as possible and should Include 
specification of desirable or correct alterhdtlves. ^ 

/ 
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PART I J ORGANIZATION AND.MANGEMENT 

/ . 

GfiTT I NG THE an LOREN«S ATTENTION (Principles I and 2) 

It fs Important to catch and iftalntaln the children's attention at th^ 

• * * 

beginning of the. lesson* 

* « * • 

I. The teacher should use a standard and prodlctabto stonal to got the 
children's attentlot» « The use of this tecj^nlquo should lead to. quicker and easier- 
transitions with little time wasted In getting a group started. It Is useful 
In two situations. The first U the transition from general class activities 
to tho reading group (and alternaie activities), and the second situation Is 
getting everyone's attention when you actually begin tho reading group. 

A standard and predictable signal is one which the children can learn to 
recognize quickly because It Is repeated dally wJth the same meaning.. For 
example, the teacher might ring a boll every tJay to signify that It Is time 
to move to the first reading group, or she might give a consistent verbal , 
signal, such as "It's time for Tigers!" If the signal Is clear and consistent, 
tho children- do not have to stop each time and decide what to. do; they can 
respond quickly and automatically. Tho teacncr should decide upon the sl^gnal . 
©arty In the year and the children should bo allowed to practice responding 
to the cue. 

* 

Once tho '.hi Idren are In the group, tho teacher should aqaln use a con- 

♦ 

& I stent recoqnizable signal Indicating that the lesson is about to begfn and 
that the children should pay attention. For example, she could use a phrase 
every day ouch as "Attention, children." Aqain, by consistently using the 
saroo slqnal the children loarn more casl ty when lessons are starting, and tho ^ 
toachtT will spend losr. time gettln«^ 1hc f^roun ornijni rod. 

% 

In either siluatlon, if sorr*^ children do not respond to the stqnal, 1he 

« 
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toacher Should Qsmlnd them Individually of what Is expected, Howevei^^ tf ^ 
teacher should be careful not to Interrupt the appropriate J>ehav I or of the 
oth'or children* or reward the unattending child wjth too much attention (by 
.shouting^ scolding foudly, etc.). lnst«>ad, the teacher can tap or softly call 
tl^f names of those who are not attending. If this stlM "does not lead to the 
desired behavior, the teacher should quietly and quickly explain the meaning 
of the signal and mak^ sure that the child follows through. It Is Important 
that the teacher remain consistent ar^d firm In her demands that the children 
respond to the signal. 

\ 

2. Once In the group, the chl Idren should be seated with their backs 
to the, rest of the class while the teacher Is faclnovthe class . This Is a" 
prove/tlve measure In that the children In the group are less jUely to be 
04stracted by other activities If they face the teacher and have the4r backs 
toward the r/est ofthe class.. Alsd, the teacher can supervise both the 
small group and 'the remainder of the class at the same time In this position. 




i?.'..-0 
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INTROUUCIN& NEW MATERIA (Principles 3,4,5, «nd 6) . , 

The Introduction should preparet children for the lesson by getting 

their attention, 'teaching now .R>a tori a I and new terms before applying them, 

V, • ♦ . 

and making sure that the children know what to>do when they ^re asked to make 

* « 

responses. 

3e * The tntroductlbn should contain arr overview of what Is to come In 
order, to mortally prepare the children, for the presentation^ This does n<S 
have to bo elaborate (In fact. It should not Uo). A senteTteo or two wiTl do, . 
sjjch as **Today we aro going to learn about: a sound the letter a makes," S'uch 
an overview should contain a statement about the content to b'b studied* It 
may or may not be expressed In tenr» of a behavioral objective (as In, "At 
the end of the lesson, you will know about two dif^ferent sounds for th."). 
The ovtervlew may also, mention something about the purpose of +her lesson, especial I y 

• • % ' • \ 

If this Is likely to motivate the students • For example^ the teacher may say, 

. ■ 0 

"Today we are going to learn about words wltto two vowels side by side. When 
you know about this, you iJlll be able to road a lot of new words that you could 
not before, like boat, and seat , and sal l «" 

If the lesson will Involve changing activities at.some point (and especially 
If the te'achor anticipates breaking up the group to work with certain chlldren^^ 
as discussed In Principles 13 and 14), It may be useful to give. the chlldr^> 
a preview of " the stjquence of events, (fo^ example, "Today wc will, ta\k about some 
words like t hrough , rough; and althounh . They sound different but thoy .look 
a lot alike. After wo talk about thorn for awhile, some Of you will go do work- 
book oxercli.o5, sook; of you wlU go to the llolcnlng center, and some of you . 
will stay and tafk with mo."). This preptirus the 'children for a future transi- 
tion, tind 11 .jlr.o lotn them know In advance that r.evcrol different activities 
will take place. The children then will bo expecting these directions when 

. ),9i 
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they are repeated later* • 

The purpose of overviews such as these Is to prepare the children by 

• • • * 

helping them to organize their thinking and focus on tt»e task at hrfnd* It Is 
Important for them to learn tt^t the world of school and Its demands (specific- 
ally reading) Is a reasonable and orderly one. One step towand helping, them 
Ifirn this Is always to prepare them before making demands on them, and then to 
foll^ that plan accurately so that their expectations of the lesson are ful- 
filled. . ' . 

4. it Is also at the bf»glnnlng of the lesson that new words and sounds 
should be presented ^o the chl ldren > so that they can use them later when they 
are reading or answering quest4cns. Introduction of new worths may be accom-'' 
pllshed In several ways, depending upon the words, the children, and the teacher. 
Words that do not* f^ low phonics .ru4es .and cannot i>e -funded out by the children 
should be said clearly by the teacher. Words that could be sounded out by the 
children may be presented as questions to them,' a Pong with whatever other clues 
may be helpful. Or, If >he teacher prefers, these words also could be given 

to the chHdren by her.' The Important thing Is that these new words are spoken 

In some form at the beginning of the lesson. The teacher should see that they 

are distinctly pronounced .and pointed to, expl>alnod, or otherwise focused upon. 

This technique lets the cKlldrcn know what to expect, so that they can re^d 

without anticipating totally unfami Uar words. They can be looking for them, 

and their learning of the words will bo reinforced when thoy see them again. 

• / *• ... 

5. When new word*; or sounds havo been nresonted, the teacher should have ^ 

the children repeat them unt 1 1 thoy can. say thorn sot! sfoctori ly. leaving them 
repeat the words or perhaps make up sentences with thcmglves them' practice in 
reading and siiylnri now words before they are called on to road thorn :n context. 

N 
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It ts also a relatively easy task» so that children who are shy about respond* 
Ing will find thts first demand less frightening .than a more complicated 

* ♦ • 

.6, After moving 4nto the lesson, but before asking the children to use 

new material or undertake new tasks, the teacher should present a demonstration 
and/or; explanation of any new bctlvlts^ A good explanation Includes a step- 
by-step description of the processes Involved , given In simple, clear language 
that the chl'ldren can understand. The te^er should gear the ekplfinatlon 
to the chlldren*s experience and level of understanding. For ^xfmple; If the 
task was to find pictures i^hose nanjes started with the same sound as the name 
of the. letter just studied, the teacher might say, "Show me all the pictures 
whose names begin with the /b/ sound," But If the children had neve n per termed 
this task before and were not familiar with the skills Involved, this might 
be a poor explanation, A better approach would be to break the task Into each 
step .and explain sdquem lally, _ * 

For example, with a readiness group that had never before tried this task, 
the tea'chor might say (after an overview and presentation of the letter sound 
being studied), "First look at this* lottel-, b. What sound docs It make?" 
(ChMd responds.) "Say the sound to yoflrself. Now look at this picture. What 
Is the namo of the picture?",,, "Say the. name to yours9lf. What Is the first 
sound In that name?,,,. Is that the same sound as the sound of this letter?" 
If the children could answer each of those questions, the teacher could pre- 
<ont the next picture with fewer questions. For example, she might say, "Now 
look at this picture and say the namo to yoursoTf, Listen to tho first eound. 
Is the first sound the same as the sound of this lottor?" Later, this could 
bo furfhcr shortened to "Look at this picture and ^11 mo if the first sound In 
lt?i namo Is the same as tho sound of this iottbr./' Eventual ry, tho children 
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could b6 given th« explanation presented first above <**ShoM ii>e;all the 
pictures Whose naniee begin. with the /b/ sound***) • 

^ * * 

Therefore, the'crlterle for a good .demonstration or explanation Involve 

checking the children for their level of understanding and then. If neces- ' 

. ' ♦ • • • 

sary, either expanding on the explanation by breaking It Into steps or shor- 

tening It by leaving out a, few steps at a time. The teacher's choice depends 

upon the children's responses at any point In the explanation. 

After the explanation or demonstration, tho teapher should move quickly 

♦ 

to haying the children do the tiisk themselves. Children In this age range ^ 
need concrete personal experience to learn concepts or skills, but they also 
need guidance to point out the most Important features of the task. Having 
the chi ldren perform -l^e task In the group not only helps them learn It, but also 
allows the teacher to check them for understanding pf the Instructions before 
they, are released to work on fhelr own or expected to respond correctly In a 
more rapidly paced group session. • 



♦ ♦ 
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CAUIN6 0N aULOREN (Principles :^,8,9,I0,II, and 12) 

« 

Colling onxhltdron Involves .distrlbotlhg rosponso opportunities to 
Individuals while at the same time keeping the enti^® group alert. 

* ♦ 

7, The teacher should work with one Individual at a time In having 
the chlldreo practice the new skill or apply the new concept/ making sure 
tJ^at everyone Is checked and receives feedback during the lesson., (Feedback 
Is discussed below In principles 16 through 2le) In this way, "the tpacher 
cnn monitor +he progress of each group member. This roeans^ that excessive use* 
of choral responses Is not desirable* • • . 

a. The teacher should uso a pattern (such as goIn<? from one end of the 
group to the other) for selecting ohlldren to take their turns reading In^the 
group or answering questions (as opposed to calling on them randomly and un- 
predictably). For example, the teacher can §tart with thechi Id to her 
Iwnedlate left, then the child to his left, an3 so on ground the circle, 
questioning each child or asking for reading. 

This Is suggested because the children will always know when to expect 
a turn and will not feel anxiety about being called on unexpectedly. This' Is 
' espcQlafly Impbrtant with young children who feel uncertain about havl^ng to 
p^fl^rfprm In school, and It also will help to control overeagor students who 
froqucnlly call out answers, wave their hands, and engage In attention-seeking 
activity because they think it wllf lead to a turn to road or respond. , 
Both shy, non-rosponsl ve chl IJ^ron and attention-seeking, overeagor ones will 
know when their turn Is cotntng and will not spend the rest of time feeling 
anxious or trying to get attention. The teacher must remain firm in her use 
of this procedure ,and nbt skip a shy child to yletd to a handwaver, except In 
the situations discussed below. 



• 9* In brdor to toep each member of the group alert and accoun^tabie 

at III! times belveen turns, the teacher *occa&lonatlv should Question a child 

about a previous response from another chl Id (for example, **BI II, how do you 
>' . • . 

feel aobut John*s Idea?** pr **Po you have anything to add to that?'*) Thus,. 

each student should know that he may be' called upon at. any tlitte, not Just . 

during his turn. He must* therefore remain attentive and listen to the other 

ciilldren. However, fwo precautions should be taken when using this technlqoe. 

First, when a child Is questioned about another's response, the demand made, on 

the child should be an 'easy one for him. That Is, If he was listening and pafy- 

Ing attention, he should be able to answer the question- without difficulty. For 

some children, sucH demands are as simple as asking for a repetition, or oplnlonX 

Other children might be asked to cociment on thiB correctness of the answer or 

to expand upon \i (but only If the teacher, feels this Is within their capabl l-'« 

« 

Itles). 

If harder demands are made than a child can fulfill with this type of 

questioning, the advantage of reducing anxiety by using a predetortnlned order 

"(as discussed In principle 8) will be lost. If all of the out-of-tum questions 

are simple for each child, they will not learn to fear them. Instead, they will 

be rewarded for ^^ylng attention and listening, and they, will get an extra. 

opportunity to give a correct answer. 

As a second precaution; the child should bo helped to realize ihif the 

purpose of such questioning Is to got his opinion or Input, not to put down ♦ - 

or ''correct** another child. The teacher can. servo as a model through her\ 

responses by treating wrorig. answers as a reason to teach, not 1o criticize. 

The use of these two principles should create a desirable balance 

between predictability, which helps reduce anxiety and/or attention seeking 

behavior, and continuous alertness within the whole group. ♦ 

0 ^ 
•/ 1) 
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10* Calling on voTuriteers shou-l^te Drfiwrllv restricted to ijarts of tho 
lesson In which chltdreA-are contributing personal experiences or opinions, 
However, when;;^hl objectlv;^ of the lesson Is to teach some content or skill. 
It Is^lmportant that every chl Id be called upon and •expected to respond. This 
can bo!>t be accomplished by using ordered turns and occasionally questioning 
chl Idren out of turn to keep them a*lert« 

♦ • • 

II. When call outs occur, the teacher should remind the child the t 

» 

evervono oots a turn and that he must wait until hts turn to ans wer. It Is 
Inportant not .to be overly critical-, however, especially H the call out 
demonstrates enthusiasm In a child who usually does not exhibit It. Never- 
theless, all children should learn that when one child Is asked a question, 
he Is^ responsible for the answer*, and others are not to call out the answer 
or "help-*' * \ 

If^cht Id persists In calling out despite repeated reminders, the 
teacher must determine why he .Is doing so. Her later reactions then are 
determined by the reason for the behavior. For example. If the calling out 
primarily seems to be to get attention, the teacher shou I d make sure that 
her responses are not relnforcl»ng the behavior by paying attention to It. 
.Reminders can be delivered Impersonally to tho child, without looking at him 

^ * ♦ • 

or seeming to speak directly to him (thus not rewandlng him with attention), 
or tho teacher can totally Ignore tho s^-udent's call. outs and only respond to 
answers given durlrig his turn. 

Anolhor reason for repetitive. ca 1 1 outs might bo that the child Is 
impulsive and has little self-control. In this case, the toacher'may help 
tho child become aware of his behavior so that ho can begin to control It. 

It Is Important that tho teacher never accept. a callod-out answer. 
Call outs should bo Ignored or should result In a reminder that everyone Is 

-291- 



expected to wait his turn or raise his hand and be called on by the teapher. 
In contrast to this response to.call outs, the teacher should be sure tt^at she 
does respond positively to answers given during a child's turn, dn the case 
of a typically non- responsive child who dpes make a rare call-out, the tdacher 
should not lose the oppot;tunlty to reinforce the response, while gently re- 
minding the child If she can that It would be better to answer during his turn. 
Otherwise, however, the teacher should not accept the answocs called out.) 

The purpose of this principle Is to>t only help maintain control but 
to teach children to listen to others and not to interrupt. 

12. The teachec^hould avoid rhetorical questions, asked for effect 
with no answer »vni.cted. o^ l eading Questions (^*WasnH that funnv?«), /Other . 
niiftst.onInQ patti^rns to be avoided are answering her own quest ions ("Why dH 
the fanner qo to town? - To buy a pig, of course!'; without waiting for an 
answer) rA pA;.tlnn questions (''Why did the fanner go to town? What did 
he want to do? Why did he go?", again without waiting for an answer). 
These kinds of questions tend to confSse the chl Idren and wl ll also make It 
more- difficult to teach them that each teacher Question demands an answer. 
When the children are always asked questions that can be dealt with and have, 
sensible answers, .they are mre likely to *orm the attitude that school 
demands are reasonable and can always bo ansv^ered eventually. 

. When rhetorical or leading questions are asked fror.uontly, the children 
may learn that an answer Is not expected or that It can be figured out from the 
tone of the teacher's voice (as In "Wasn't that funny?" or "Don't you feel 
sorry for poor old Nobbln?"). I.f the teacher frequently answers her own 
questions without paqslng for an answer, the children may bo confused and not 
• SCO tho connection botwcon tho dlfteront eiprooslonr, of the saroo quostloc 
To thorn, tho abovo oxompio ("Why did tho Urmr. . J What did ho want? Why 
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dld^he goV^) might appear to be several questions ^t once^ which ooutd 
confuse some firsts-graders* 

Ins toad « good questions for this group should be short, enough 
♦for the chfldren to hold In their memory whi te thinking about the answer^ 
They should elicit some mental activity beyond second-guessing the teacher 

e 

trojspondlng' to "her tone of voice rather than the content of th^ question) |, 
and they should have answei^ which make sense to a young cbl Id who cannot 
think abstractly or juggle too many concepts at the same ^Ime. By consistent 
use of reasonable questions, the teacher can help proraot^ln her students the 
'Idea that school tasks are reasonable and within their capabilities. 



« 
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MEETING INDIVIDUAL LEARNING NEEDS WHHW THE ,0«)UP (PrlnclpNos .13^14,15, and 16) 

\ 

Mooting each Individual's learning i)eeds may Involve brel^klng up the 
group* using, another child as a model* and arranging for tutorial help. 

13. At some point during t'he lesson* the teacher must make a fundamental 
decision- about whether the group as a whole can or cannot mce-t the lessors 
objectives . If there are largo Individual differences In the rate of learning, 
keeping the group together might mean spending too much time with those who 
are having difficulty. When this Is not the caso and the group as a whole can 
meet the objectives, the toachor should keep the group together, concentrating 
her attention at each step on tho slowest members, working wlfh them until they 
master the step before proceeding to the next one. In this fashion, all of 
the children will achieve at least the minimal objectives of the lesson. 

14, If the toachor decides that the nroup as a whole cannot roach the 
o b.'ect i vos at the samo time because of large individual dlfferencos In compre- 
hension of the material .^'she should proceed differently . Those students who 
already know the objectives or who aro learning rapidly and easl ly -should bo 

♦taught through to tho end of the lesson and then dismissed from the group to 

0 

.work independently or^engago In some approved self-chosen activity such as com- 
pleting .workbook assignments. Meanwhile, tho toachor should continue to work 
with the rest of the group until all children master the objectives, perhaps 
dismissing them ono by one as they do. 

»Thc toachor should be careful to avoid negative statements regarding 
the children who remain for extra help. The children who have mastered the 
lesson should* be dismissed wltbou'V fanfare and without calling attention to 
the fact that they have succeeded. Similarly, tho remalnlnn children should 
nol got tho imnrccslon that they hove failed or done somethinn wroru? bccau<.o 
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they remain In the >^roup. One way to handle- this situation might be to let 
the group know In advance « perhaps In the introduction^ that th^y might have 
different activities, to complete after reading group. When tRe time comos to • 
split up the group » the teacher could dismiss those who have jmastered the 
objectives with Instructions to complete a workbook activity or go to a learn- 
Ing center, for example. She could then continue with the remalnlng.chi Idren, 
either with the original lesson plans or with another activity such as those 
suggested In the teacher's manual for children with Individual needs. If the 
children ask why they are staying behind, the teacher should. answer positively 
("Everyone has different work to do. This Is your work for today."). 

15. Sometimes the *teaefaer may wish to use one or more chl Idren who have 

* 

mastered the objectives to serve as models for the others . This may. be .done 
with the group Intact, or the teacher may dismiss all but the models and the 
children who need ext,3 help. Some.tlmes, children having difficulty attaining 
objectives may benefit more from observing Interactions between the teacher and 
students who already understand the process than they would from being questioned 
themselves. For example, the teacher might be teaching the difference between 
the sounds of words like tape and ta2. (to present the" Idea of a final e making 
the vowel sound long). The teacher might ask a child who does not- understand 
this concept to read pairs of words, then give him the answers each time with en 
oxplfination. But doing this repcfatedly for several pairs of words may prove 
frustrating for both chl Id and teacher. Thus, It may make more sense for the 
Icacher tokecp children who have mastered the objectives In the group In order 
to carry on a dialogue or demonstration with them and provide a model for the 
oth<?r chl Idrcn, She can then turn her attention back to the others after they 
h.ivo had additional opportunities to see and hoar the answer and explanation 
modqjjj^d so vera I times. 
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An advantage cf using models Is that ch 11 drer^ often pay attention to 
and'jmitate peers whom they respect and ftke/ Therefore, the tea^hey should 
be careful to help the model maintain the respect and friendship of his peers^ 
and to prevent any resentment which might arise If the situation Is mishandled^ 

* *.* 

In particular, the teacher should not make the other- eh 1 1 dren look biid while 
making a good example of the ihodej>(s). Instep of saying something like, ' 
"Janet's^ so smai^. She knows the rule," the teacher should contain her commentsr 
to the answer. Itself, pc^ the students' abilities. When commenting on a model's 
answer, the teacher should be spe'clflc about what was correc. and why, since 
this helps the other students to focus on the Important aspects of the problem 
("That's right, you looked at* that last letter to see If It was an e before 
you said the word.**) 

16. If one or more chMdron stUI do not succeed In meeting the objectives 
within the time available for the lesson, provision should be made for tutorial 
assistance. This might come from the teacher nerself or from peers who have 
mastered the lesson's objectives. In any case, students who fall to meet object- 
tlves should receive extra help, and must not be allowed to tall progressively 
behind. As stated In principle 14, such assistance should be given In a posl- 
.tlve manner so that the children do not get the Impression that they have failed 
or done something wrong. The suggestions In the teacher's manuals can, of 
course, be used for activities. When the teacher's time is f I ml ted, parent 
volunteers or older students might serve to help these students; 
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PART II J RESP0M0U«3 TO CHILOa£N«S AN^'/ERS ' . . 

* . * ♦ 

The previous section dealt with group managernant practices, Tl^e second 
p^art of the system Is concerned directly W'lth the teachor*'s role In, dealing 
with Individual students within the group. The teacher 'flas tv/o major responsl- 
bllltles In an academic exchange, with the child: she roust present the question, • 
and then respond to the child's answer with feedback of some ^ort. The 
following principles focus primarily on<the latter, 

\^ Three distinctions wHl noW be C9nsldered In turn, and^thon wlH be used 
to Explain how the teacher decides what kind of feedback she will give; These 
distinctions are types of ouortlon, types of learning and aptxroprlatQ paclno, 
and types of chUd ansv/ers» 

♦ 

Que<;tIons 

There are two basic types of questions. The first Is a question that.^* 

cal'ls^for a short, factual answer. Those often deal with natters of fact which 

one either knows or does not know. Answering such questions requires remembering 

Information, Thus, It Is not possible to "think them out." Questions of this 

I 

sort usually start with' v/ho , when , what^ and where' and might entail supplying" 
labels or dates, or reading sight words. For example, when asked "V/hat shape 
Is this?" a child either does or does rtot recall the name. Generally, he 
cannot bo ho I pod with a clue. 

The second kind of question can be reasoned out. This Includes some who, 
what , when, and where questions that' ask for mora than a label (such as a 
question about story content.) This tyoe of question also Includes how and 
why questions which do not have short factual ansv/ers. Example's are, "V/hy 
do Esklnos v/car v/orm clothes?" and "How can you toll whon it Is tirno to got 
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upt** Giving the chltdron cTues can help thttn to reason or remembet answers ' 
to thoso questions. For^ example^ a clue to the Eskimo question might be^ 
•'Would you Wear a bathing suit In the snow?'* Then jafter a response, "Why not?»» 
^ese two different types of questions make different demands on the child* 
Purely factual or labeling quest loKs call on memory alone, whih other ques- / 
tlons also may call on reasoning processes. 

Types of Learning and Appropriate Pacing 
Different types of learning will require different strategies* 1^^ pacing 
the speed of questioning. The distinction to be made here Is between 

* . • * 

I), demands for rote memory suitable to drill and 2h questions requiring 
reasoning wfilch cannot be answered automatically. Examples of rote learning 
are recognition of slgl\t words and recitation of the multiplication tables. 
The children are expected to respond quickly to sych questions Without having 
to stop and think. Reasoning <lemands ask a child to apply a process (^fuch 
as a word attack skill) or give an ahswcr which requires some thought, such 
as menvory of story content or an opinion. In general, rote learning Is more 
easily accomplished with a rapid pace, while demands requiring more thinking 
should be presented with a slower pace. T!»e teacher must dcpWe what demands 
she Is making of her children, and then sot the pace which will best maet 

the objective. * 

« 

In a rapidly paced Ibsson, thk teacher rnovas qutcl;lj/''^f rom child to chjlc', 

♦ 

The purpose of such a pace Is to provide each ans\/or nany tlm^ss, so that the 
children can loarn through rapid repetition to recoyulze words, letters, etc. 
on sight ajtomatlcally." The child loarns to do this from hearing and -seeing 
repoatodly the association betwsen the question and answer. 
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Axaptd pace can be matntalnod vthen short feedback ts given rather than 
elaborate feedback* The teacher^ waits only two. to three soconds fdr a child 
to respond/ If there Is* not a response, the answer Is given and the teacher, 
-moves on* Appropriate feedbacl; during rapid pacing Is further discussed In 
principles 17, 18, and I,9# 

A slower paced l<»s3on Is one In which the teacher spends more t = n- 
, with e&ch child and each question and gives nore extonslv3 feedback. This 
type of pace Is suitable for demands requiring reasoning or use of new 
skills. In these situations the child learns hy doing the process or by seeing 
It done and explained. For example, learning to sound ojut new words with certain 
combinations of sounds Is a more complex process than the simple associative 
learning of cannon words as described above* This second type of learning 
often requires explanations and the process of getting an ansv/er Is usually 
more Important than the answer Ifself. Tho feedback to be used In a slower-paced 
lesson Isalso discussed In more detail In principles 17, 18, and 19. 

Typo of ch II d ans./ors 

Chi I dren's. answers may be cicjislfled as (I) mostly or all correct, 

(2) mostly or all Incorrect (wo Include In this category the answer "1 

don't know,** which Indicates a lack of knowledge), or 43) no response at all. 

S 

Each of those situations requires a different response from the teachsr, 
depondlng on the dcmands'of the question and the capability of tho chlK.. 

The rost of the principles are based on the premise that any chi IdVs 
response can t?o turned Into a^ pleasant learn Inn experlonco by the teacher . 
Therefore^ wrong answers and don*t knov/" sta omonts are not uhdoslrable 
In. themselves* ^Thoy can be used to promote Ijarning whon handled v/clU 
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Howover^ a fatluro to respond Is -not destrabU, ind the child shout d be en«**^ 
coura^od to respond In some way, even If to say •* I don't ^^^now." It Is then 
the responsibility of the teacher to loayd the child with a.goo«l feeling 
nbout having resi^ondod, even If It was only to listen to the correct answer 
and repeat tt« 

The. rest of the principles discuss teacher. feedback to different > 

♦ 

t\'pes of child answers* Types of questions and types o^paclng are discussed 

* ♦ 

under each category, A summary of appropriate use of feedback appears In 

* * 

chart form following the ^d I scuss Ion of prfnclples 17, 18, 19, and 20, 
«N TOE CHIt.0 DOES NOT RESP0r40 . 

17, When the teacher asks a question or gives a direction, she should wait 
for the child to respond, and al^o see that the rest of the group waits and 
does not call out answers, .The length of time spent waiting for an ansv/er 
depends on'v/hat kind of pace the teacher wishes to K^^ep up* Vihen the group 
Is moving tnrough rapidly paced ques^tlonlng (sdch as drilling on sight words), 
she should wait only a few seconds* and proceed by giving the answer herself If 

the child does not respond, Floweven, when the pace Is slower, the teacher should 

I I - I 

continue to wait for a response for as long as the child looks like ho* Is 

« 

thinking about an answoV^and may comd up with one. However, she should not 

t 

wait so long that tHo group's attention Is lost or the situation becomes anxlety- 
. producing- for the child. The teacher must decide on the-spot what Is the optimal 
walt-tlroc. 

If the teacher Is unsure about whether a child Is still thinking about 
a problem or whether ho Is completely stumpeJ, sho should ask him ("Oo you 
know?** "Can you do^lt?") and then prococd on the -4)93 is of the child's respdns-. 
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If tho child says he doos not know or cannot do It, the teacher shouJd refer 
to the discussion of "When the child Is wrong or does not know* (Principle 17). 

If the child still does not respond within a reasonable time during slov/er 
paced questioning, i*he t©achec,5houU provide hefp, by simplifying the 
question by degrees but ^always attempting to get son» response (see strategies 
for simplifying questions below). If. necessary, she should at least get a 
•Ves-rioV answer to the question »»Do you know the answer?" By making sure to 
get am overt verbal response to every question she asks, vhe wlH gradually 
condition the children to respond to every question. 

« 

If the child still doesn't respond, or If he finally responds Incorrectly 
or says "I don't know/» the leadier should follow procedures for simplifying 
as discussed below. In j7l9, 

* 

A child who persistently requires encouragement to respond will probably 
require some 'tutorial assistance and shoul-d probably receive fewer and easier 
group demands until he Is more willing and able to respond. ^ 

V/HEN THE a^lLO IS l!ICOnnECt OR DOES NOT !m/*T}{E A?iSV/ER 

- 

18. Wrong answers and *M don't know" statements should not be met with 
negative reactions by the teacher. If the child responds Incorrectly, the 
teacher should first tell him that theranswer Is not right. , She can do this 
by using such phrases as "No, that's not right" delivered In a ncn-crltlcal 
voice, or she can acknowledge that the answer was partly right or that the 
chlld.was using the right process but misapplied It or didn't complete It: 
"That's good; you remembered to think, about "these beginning and ending 
sounds, but the word Isn't rlght««It doesn't make sense there." In pointing 
out that the answer Is wrong, the teacher should be as specific as possible 
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about what was wrong* ' ' . 

When the child has answered Incorrectly, the tocher should follow the 
simplification procetlures outlined lo the next section. Thesfe are the same 
procedures to be used with a non-responsive CRIld, usually after the teacher 
has elicited at least a statement of "I don't kncM^ from him, * 

Simi'FICATlON PROC^DU^S * » * '* ' 

19. Afi^r attempting to get a response or acknowledging that an answer Is 
wrong, the teacher has two options for slmpllfylng^the question. She may 
give the correct answer to the child, or she may rephrase the question and 
give clues. ' 

a. If the question deals wl.th a matter of fact, so that the response 
cannot be reasoned out, the teacher must give the child the answer. She should 
not ask another child to provide It. Calling on others In fhis way can create 
bad feelings and over-competltlvenoss. Also, this may convince the children 
that If they do not respond or don*t try to answer correctly, the' teacher 
will eventually go on to someone else. Staying with the child until an answer 
Is established and attempting to ellcH som acceptable response from him 
will Instead teach the children that they must listen, think, .and respond. 

Providing the. answer to the child can, be done In several ways. If the 
pace Is rapid, the teacher should give the aosv«'or and move on, perhaps 
occasionally having a child repeat tlio Vesponse. If the pace Is slow, the 
question can be restated In a form w^lch simply calls for agreement, repetition, 
or choosing between alternatives. For example, the quesMcn "V/hat punctuation 
mark Is this?" can bo simplified to *Ms It o comma or a period?" 'Hero, 
the child only has to make a choice. If the choice Is stl 1 1 too difficult, 
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one of the options can be made inore. apparent, such as, "Is It a coipma or u 
question niark?** An extension of this Is to. make one of the alternatlvas so 
ridiculous that the child not only enjoys It but Sdes that the correct 
choice Is obvious ("Is It a comma or a worm?"). The child might also be given 
the opportunity to n^ke a yes-no choice 6y questions such as 'Ms It a comma?*-* 
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Another strategy for simplifying factual ^questions which leads almost 
certainty to a correct response Is to give the answer and ask the child to 
repeat It. For some children, repetition may be the only demand to which 
they can comfortably respond at first. 

Giving thfe answer to the child In the form of a simplified question to 
.which he can .respond enables the child to succeed. This Is particularly 
l^nportant for children who are anxious about responding or who seldom get a 
right answer. With children who generally reply quickly and correctly. It • * . 
..usually 16 not necessary- to always provide a success experience', especially 
when the questioning is rapidly paced and the teacher know^ that the child 
will not react negatively to b-cing told the right answer. 

b. If the question is such that the child can be expected to figure 
It out If given help, the teacher should give cluo^ or rephrase the question 
In a way that guides the child's fhinking in the right direction, if the clues 
do not help and {>ivlnfi the annv/or is nccosDory, the tenchor should qivo It - 
herself rather than call on another child for it, 

■ One way to rephrase a question might bo to break It dov/n into a sequence 
of rotated questions. For example. In reviewing a story from the day before, 
* the -teacher might ask, "tlow did Tom make the bread?" If Ihc child could not 
remember all the steps, the teacher could break if down into, "V/hat did ho 
do right after ho decided that he wanted to make 11?" Then, after an anuv/cQ 
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"What did ho do eft^r ho got homo from tho grocery store?", etc. 

' Another example of breaking a question dovm Into sequential steps might 
be hi helping a Ohild sound ou,t a nev/ word, (*'V/hat Is the beginning sound?*' 
Cresponsel, "What do you know about those vowels In the middle?" Cresponsel, 
"Read the rest of the sentence. What word makes sense, there that has the sounds 

* 

you Just read?") , • ' 

Another way to rephrase a question, especially a "why" question. Is to 
help the child focus on relevant aspects of the situation. For example. If ' 
the question was, ''V/hy Is thqre a railing around the Tiger Pit?", the teacher 

« < 

might say, "Well, If there was no railing around the cage, what might happen 
If the tiger decided to take a walk?". Or she might ask, "What would happen 
<f the tiger got out of his cage?"-, and then, after answers, "When tho. rail Is 
there, can tho tiger get out of his cage?" 

Sometimes, rephrasing "of the question Into simpler language may be suffl- 
dent to help the student. For. example, "Mamo itud some reasons that Tom .and 
his family wore eager to get started," might be more easily undenstood as 
"Why did Tom's family want to go?" *^ 

Simplification, ^therefore, involves breaking a question down Into a simpler 
form'that helps the child direct his thinking to tho right answer. V'lth ques- 
tlons requiring reasoning or application of a skill, the methods of simplifi- 
cation con bo more cooiplcx and extensive thfirt t..e methods described above 
(under heading 19 a) for factual questions. 

s 

If simplification of reasoning questions docs not help tho child get on 
tho right track, the teacher should' supply tho answer, along with an explana- 
tion of tho thought process involved in figuring It out ("You have to say the 
beginning sound, thftn the end sound, then look to doo if ypu know anythinn about 
tho le^tors in tho middle. Then think what wrd h«jr> thotic sounds ano ma- 
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sende thore»«) ^Agaln, In supplying the answer to ^ child, the teacher should 
try to finish with a question or response demand that the child can handle 
successfully, especially If the child Is shy or apprehensive about responding. 

WHEN THE CHILD IS CORRECT . . 

20. If the child answers correctly, the teacher should acknowledge It. 

This can be done briefly by a nod, by repeating the answer, or by verbal In- 

d I cat I on of agreement, such as "right", "okay", etc. Praise may or may not 

be appropriate, and Is further discussed In principles 2\ and 22 below. After 

acknowledging a correct answer, the teachen should jnake sure that the rest of 

.... • * " ) V, 

the group has heard and understood. If the others did not hear, she should 

have thi? child repeat tKe answer more loudly. The teacher might also repeat 

the answer herself and paraphrase It, although she should not get Into the 

habit of following every answer with repetition, since the^hlldren may stbp 

listening to one another's answers. Sometimes she should ask another child 

« 

to repeat the answer, as discussed In prinoiple 9. 



Teacher Responses to Chlldrbn*s Answers t Summary 

This chart summarizes principled 17, 18, 19, and 20. The teacher bases 
herlfeholce of feedback on the typ^ of question, the* pace, and the chlld*s answer. 



TYPE OF QUCSTION PACE O^ILD^S RCSPONSE 



Factua f (chl Id 
cannot be helped 
to figure out the 
answer^ If 'he does 
not kn6w) 



Rapid Mo response 

Incorrect or^ 
mostly Incorrect 



Correct or 
mostly correct 



Slow Uo response 



Incorrect or 
mostly incorrect 



Correct or 
mostly correct 



•Reason I nq (child Slow fJo response 
can be hnlpod to 
figure out the 
answer). 



Incorrect or 
mostly incorrect 



Correct or 
mostly correct 



FEEDBACK f?CSPOMSF ' 

Teacher (T.) waits only a few se- 
conds, gives the answer and moxes 
on. 

T. says that the answer Is Incor- 
rect, gives the correct answer 
and moves on. 

y 

T, acknowledges. that the answer 
Is. correct. She flakes sure, ail 
have heard the answer and moves on. 

T. waits longer for a response 
(as long as the child seems to 
be thinking about it), then she 
simplifies it to get some overt 
verbal response, arf4 deals with 
the verbalization as correct or 
Incorrect. 

T. tells the student the answer 
Is incorrect, simplifies the' 
question by giving a choice or 
givei 1he answer and lots the 
student repeat It. 

T. acknowledges the correctness 
and makes sure all have heard. 

!♦ waits for a responriO ar> lonn 
as the child sooms to be think inn 
about it, slmpfifinf* the nuestion 
to pot some vorbal roGponso, then 
deals v/ith the vorbn I izntion as 
correct or incorrect* 

tolls the student the answer is 
incorrect or partly correct, com- 
ments on the procp!;r> whore anpro-* 
priale, then sinphfios the question* 

T, acknowf odM'^s ihat the response 
is correct, cor^nonts on the process 
where it is oppronrldte, and nakos 
sure all have h^Mrd* 




-306- 



ERIC 



PRAISE mo CRITICISM * ' 

21. Praise ts an J.mportantv^spect of teaching end should be used regularly 
but not Indiscriminately. When used slncerefy* It can reinforce desired behaviors 
and favorably Influence the chlldrens* attitudes about themselves /Jnd school. 
The teacher should take care to praise the child's effort and/or thinking 
processes used in arriving at an answer, not Just the answer itself . The 

* v% 

teachecirfihould use a variety* of praise statements rather than rely on a single 
stock phrase, and should, avoid praising too frequently lest her praise become 
taken for granted. During rapidly paced portions of the lesson It Is probably 
best to avoid praise altogether, and Instead confine responses to confirming 
students* answers and repeating the correct answers. When the pace Is sla^'er 
and students are called upon to demonstrate newly learned or more difficult 
skills, thQ teacher should begin praising more frequently* 

Praise should be specific and individual Ized for each student. E?y being , 
specific In her praise, the teacher can help the student focus on appropriate 
behaviors. to be repeated. (This also helps make other students aware of what 
aspect(s) of the response were correct.) By making praise contingent on indi- 
vidual progress, the teacher can help each child seo and appreciate his own pro- 
gress (rather than praising only behaviors which some children have mastortjd 
and olhorshovo not). In other words, individual progress rathor than nroup noVms 
should bo the basis for praise of individual studonti;. 

For example, ^ cliild who usucjily nivor> up oa'sily on now v/ords but who, one 
day, does sound out a word should bo told, "*'ary, that was good; you looked at * 
the word and then sounded it out by yourself." Howovor, a child who consistently 
sounds out new v/ords but needs to work on pouoiof] cit the end of sentences could 
be prciii>od for doing tho iultcrj "Good, John, I likod tho way you waited after the 
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porlods." In these examples, both Mary and John wore pralnod for specific 
behaviors which Indicated progress for them . By specifying the behaviors In 
these ways, the teacher gave more Information to the children than If she had 
Just said, "Good, f'ary" or "Good, John." 

22. Children wh^ biurt out answers, call out answers ou1 of turn, respond 
impulsively, or continue to respond the same way time after time rocjardless of 
the question should be corrected, but correction should como in the form of 
criticism combined with specific positive instructions about what was wroncj and 
what should have boon done. ("Oon't just guess, think about the {iroblom first 
before you try to answer." or "Don't pj^ck out another uctlvity now. Tho bell 
has just rung and remember, that means it's time for you to go i-- reading group.") 
Criticism along, without the additional provision of positive, prescriptive in- 
formation about what to do Instead, will be of I4ttle use to tho child and 
may be harmful if it makes him Inhibited or resonlful. 
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' Appendix B 

Summary of the Observation System Used In thd 
F:lrst-Grade Reading Group Study 

This appendix summarizes the system used to collect the data described 
In the report. Full Instructions ahout using the system are contained In 
the manual (Brophy, et al., fote A). 

Figures X and 2 present the forms used with the system > and they are 
numbered to correspond to the descriptions given below* 

Appendix C contains a glossary In which terms used to describe the 
data are llsjted In alphabetical order with definitions. 

The observation system Is composed of two parts: a section for. h 
recording group data (information about events affecting the group aa a 
whole), and individual data (Information about the teacher interactions 
with Individual students)* 
Group Data 

Figure 1 presents the form used to record group data. One such sheet.. 
Is completed for each observation of a reading group. 

K Attention-getting transitions .* The observer checks either "y^s" 
or 'W'* to Indicate whether or not the teacher has used a general attention-* 
getter (that is, some signal that is delivered to the entire class to tell 
them that a transition is about to take place and a particular reading group U\ 
about to start). If "yes" Is checked, the coder indicates which kind of 
signal is uf;od by checking one of the five types listed underneath the "yes" 
caLeRory. Hie options are: 1) the use of a bell, 2) turn jag the lights 
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Figure 1 

first Ctadc Rea<Uiks dnnxf Study 
Group Coding Sheet 



I- 



tlni* to ^r^p 
tim* to T; 

roatlii# 



y 

4. 
tot«t 



te 
2e 



bolt 

ti^lvl4*roytlAO of tor tlgoal 
othor ' 



todtvU^roMtfno 
^rptf^ U f tpnot 



no tftdlvtd*€orroctlvo 

cMltf •ttontflft^ 1 2 3 4 5 
0< I00> 



3C 



i. 



tt»o to losson 

fvO» of It-Jiv/ 
correct 
t CMI4 Ott<*n<}tiio 

I ? 5 4 5 
0% tOO< 



toll 

tl^KtS 3 

ot hor ^.^^^.^^^.^ 
ot«t 



,1. fodlvld^rootlno 

2. only Iftdiv corroctlvo 

3* othor 



•I for ftlgno) 



fwnibor 



CoMc^tt !♦ no tnstr* cottont 

l« ?. <K>** » 

^*^**^* ^ * 2 * bore 

ofl«Kt.* |« n*io 2. horo 



^* _ »r^tf*C COntont 

>, *^»Pf SvP < »V ^J^* specif y oo»* , both 



m»«t 



pos 
'*4. pot 



**5» 0Kclt«m»At 



7. 
4* 



r»«*c.^«^« f»ot dor»o 



I 2 
to lOtf 



ht^h% dl«,'» issn4 w/o to^chtiiQ 
tOrf dK" 4 
ot>>or _ 

Ions <0<*vn#AU«t#dt 
3 4 5 

no dtffaroAttot 
o»p«tt«t IOA$ 



f«o<^t^ack; 

I ♦ 0cKncMlod(;cm^nt 

~*5 > <Kkt)er«)to Specific* 
4^ fr«qifOnt sp<>clflc» 

^ ^5. AUuyi specific tOOdtMKK 

VnpCi, tttt IcAS CO^i^n Icdtod t 

1 2 3 4 5 
prals* i>o4»l» Itinltf ccmtt^^t dboat 
crit. oUtor* dtffoioAt oUltttlof 



ijCATfNOt Toidior* I t 9 4 SQayotf O 
Q n/o Te Chili* I > 3 4 *rQtrfi4 

■n.\r^^ , 



T — ! 3 4 5 



te occo^fod ^ 

2« fhO«dod/fiot occur 

3. not n«odod/M>t ocet^ 

4e ropotlttofiot d«Mo 



Vifftct K ^« 

2* b« OVe 

3. oy« 

4« O* 0¥e 

5« oic« 
ChocM for foedhockt 

1 4 ^UOStlOA 

» 24 ropodt 

3« do«onstf* 

4. fttortft tot 

5* fiomi M} 

'CKf tdroA^o CoMf^rotioAStofit 

2. 251 

3. 50< 

4. m 

5. tool 
6« Cim*t roto 











"I 





















































I4 boQ^n 
dvrtr»Q 
24 9IV0 
child 
3* phontc 

CO^fOHt 

both 

ftolthor 
1 4 choral 

fndlv 
7. Oil 

tCAO 



IcWi ^ 



.OfW 



Tto?f 
TToTHSr 



Cooor 



1 4 HfK? 

2« Aiis«04n 
3. Sortos ' 
4« Oihue 
iftOtoT* 



T 



ERIC 



Figure 2 

Plmt Grmte Roiidittg fit^ Study 
Indivtaual Coding ShMt 



.1. 



1, „ 
4, 



I^aUv^ m Hi 




4*to«l*t 



IO»»f ift<t trt>y 

itjC iiiit 

I4«t lult U»ft 



■ ' stxecnor 



e 
t 

4 



4 

t 



t 
ft 
ft 

O 



e 

0 
M 
M 



4 



d . 









9 10. 






A 


ii ft i* 

t 4 4 4 
f C ft 4 

11 B T 
C C t 


# d ir e 1 

t « It 0 N 
t 0 0 H t 
S t » » ft 

e ' t 


c'x b » 

0 » It ft 

ft c 
ft 


# 

r 


rr 

M ft 

r e 
M $ 


ft ft » 

4X1 
X T C 

s 


6 4 € 
4 0 4 

t 


M 
ft 

ir 

<L 


R ^ « 

r t « 

t n yf 

B ft 


n • 

f X 
M 

t 


































«M* «** «M 






































«M* 


^Pf 
































✓* 






«Wv «M «M» 
««** 










































|«M> «M« 








*H» MM 

M» ««W<* Mli« 






































p mmmmm 



fi 14 

^^ft itt4tf0ft4t 




a 



ERIC 



3/7 



<m ana off, 3) a verbal signal, V) the delivery of a signal and then the 
'routine contacting of all individuals involved, and 5) an/ other general 
signal. 

The total nua»l)er of general signals is tiered in the blank vihidi is 

♦ 

titled "total number.** If no general attention-getter was used by the ^ 
teacher for the entire group, this is indicated by checking '^no," and one 
of the three categories under **no" is checked. 'Chose categories are; 
1) "individual-routine," in which the teacher contacts each child who is 
supposed to come to reading individually, 2) "group is signal," in which 
the children respond to the dismissal of the previous group and come to the 
reading group without being reminded by the teacher, and 3) *'other" which 
is used to designate any other way that the teacher might cause a transi- 
tion without delivering a general signal to the entire class. 

* ♦ 

♦ • 

.2. Further descriptions of tr.i nsit.ipns. VTlme to group" is the time in 
minute's (to the neatest half-minute) that elapsed between the first signal 
that called a group to the circle and the ai^rival of the last student in 
the reading group area. "Time to T" is the time elapsed In minutes (to the 
nearest half-minute) between the arrival of the last student in the reading 
group and the arrival of the teacher. Also in this section, the observer ^ 
notes whether any time noted for "time to T" was beyond her control or was 
due to routine managerial problems. • The^ "number of Individual corrective 
contacts" is entered -as the total frequency of children contacted by the 
teacher because they did not attend to the transition signal properly. The 
"percent of children attending" to the signal Is dct^'troincd by the coder and 
is entered on the scale of J, to 2» where 2. Indicates that none of the chil- 
dren attended to the signal immediaLcly, and h indJcates that all of the 
children attended iiamcdlately* 
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3. In-group attenttQn~getttng . Again the coder indicates by checking 
either "yes*' or •*no*' whetlier or not the teacher used a signal delivered 

to the entlte group in order* to get tKeir ^ittention at the beginning of 
the lesson. If "y«»" !« checked, then one of the five items underneath 
the "yes" heading, is checked to indicate what kind of signal is delivered. 
The categories here correspond to the categories described above under 
"attention getting for transitions." If no signal is given then one of 
the three categories under the '*no'* heading is checked ,v These are 
1) "individual routine", 'in which the teacher contacts each child individ- 
ually to get his or her attention, 2) "only Individual corrective" con- 
tacts, in which the teacher does not call for anyone's attention unless 
the child has misbehaved or is not attending, or does not call on anyone 
because no corrective contacts were needed, and 3) "other" which is checked 
and completed if the teacher uses any other way of calling for a child's 
attention rather than addressing a signal to the entire grpup. 

4. Further descriptions of in-group atteritlon-eettlng . "Time to lesson" 
is 'the time in minutes (to the nearest half-minute) that elapsed between 

the teacher's artrlval in the group and the beginning of the lesson (defined 
as the first academic content addressed to the group as a whole) . The 
"number of individual corrective contacts" is a count of the children cor- 
rected because they were not paying attention or were not ready to begin 
the lesson.' The "percent of children attending" at the beginning of the 
lesson is rated on a 5-point scale in which 1. indicates that no children 
were attending at the beginning of the lesson without correction and 5, 
Indicates that all of the children were attending at the beginning. 

5. Overview . The measures included here describe whether or not the 
teacher gave a general overview at the beginning of the lesson and. If / 
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hwt it was deliver^ and what effect it had» Tlie content of the overview Is 
designated by checking elnher **no Instructional content** to indicate that lio 
such statement was given, "mechanical content** to indicate that only a des- 
criptive overview was given, such as, **Today we will read pages 58-62 i** or 

« 

**speclf ic content** to Indicate that the teacher -gave an overview that eitpli- 
dtly described what lesson content would be covered that day* The motlv^- 
tlonal component of the overview is described My checking one of the five 

♦ 

categories, either "negative'^ to indicate . that the teacher made an overtly * 
negative statement about how .bad the lesson was going to be, *'none** to indi- 
cate that the teacher made no statement regarding the motivational ♦alue of 

# 

the lesson, **non8peciflc positive statements" which indicate that the teacher 
said something like, *'You are really going to 5hjoy what we arf going to do 
today/' **Specific positive motivational content** in which the teacher explain- 
ed i^hy the lesson was going to be good, such as saying *'When we finish this 
lesson you will be able to play the word ^ame that you have been wantlxvg to 
play for so long," or "both," a category which includes both the nonspecific 
positive and the specific positive statement just described. 

If either an overview regarding the content or the motivational effect 
of the lesson was given, then the **voice" and "effect" scales arc completed. 
The *'voice" scale indicates the tone of the teacher *s voice and the apparent 
excitement or favorablencss accbrded by the teacher to the upcoioing lesson. 
This ranges along a 5-point scale from 1 Indicating an obvious negative out- 
look to 5_ indicating gushing enthusla^. The "effect" sc^le ^measures the 
children's reactions to the overview and ranges from ^ indicating an overt 
negative reaction to 5 indicating excitement on the part of the children. 

6. Breaking up the group . Tliis set of^ items describes whether or not 
the teacher bi^kc up the group due to ability differences and, if so, how this 
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was handled. * The codeir checks either that the grioup vas broken \ip by 
Indicating **done»** that the group should have been brok^ up because of 
ability differences, but was not by checking **needed, t(i»t done,** or that 
the group did not need, to be broken up and consequently was not by checking 

♦ ♦ 

♦Hiot needed, not done.** If the category of **done** was checked, then the 
following Items In the section are also conpleted. The first four itei^s 
listed describe how the gtoxsp was brokeiJ» up. **Hlgh taught, dismissed*' 
Indicates that the students who were grasping the lesson more quickly "than 
. the others were taught through to -the end of the objective and then sent to 
their seats so that the teacher could work further with thoSe students who 
were not learning as Jt^idly. **High dismissed without tcaohipg** Indicates 
that the teacher went no further with the high-ability students and simply 
dismissed them and retained the lower-ability students and %»rked with them 

» • 

for the rest of the lesson. **Low dismissed" Indicates that the teacher 
sent away those children who were not catching on as quickly as the others 
and spent the rest of the group time working with those children who were 
learning rapidly. The category of "other*? is checked and completed for 
any other method of breaking u^the gtx>up due to alility differences. The 
'•expectations communicated" by breaking up the group is measured x>n a 1 to 
5 scale with 2,. indicating overt negative statements to the lower ability 
students, in which the teacher communicated to everyone that certain stu- 
dent* were not achieving as well as other students. A score of 5, on this 
scale indicates that the teacher managed to break up the group without 
overtly communicating any differential expectations. • C 

. 7. Use of a student model . The coder checks one of three items to indl 
indicate whether or not the teacher used another student an a model for the 
rest of the group in an academic interchange. "Group" is checked if the 



\ 

teacher did t^e a nodel while the group was iiitact» without sending away 

♦ # 

any of the students because of ability differences. **Broken" is checked 
if the teacher used a model after breaking up the group. due to ability 
differences and retained oh^ of the more capable students along with other 
students who needed some extra help and ^hen used the more capable student 
in an interchange to model questions and answers for the rest of the group. 

< 

• ♦ • 

"None" is checked if no use of the model is present. If a model is used in 

any way, then the rest of this section is ^com^leted. The items listed 

under the heading "feedback** describe how the teacher responded to the 

m 

model's answers along a 5~point scale. A score of 1_. indicates mere aclcnowl-> 
edgement of correctness and 5^ indicates that the teacher gave very specific 
feedback with regard to the model* s answers so that the rejst of the group 
could understand what was right about those answers, not simply that they 
were right. A scale of "expectations communicated" is also completed. A. 
score of on this scale indica^s much use of praise for the model with 

4 

jcriticism of others in the group and direct comparisons of the ability of 
the model to the ability of the other children. A score of 5^ Indicates 
that the teacher made no c<»mnents about differential ability and focused 
entirely on the answers given and the content of the lesson. ^ 
g. Appropriateness of seating . Appropriate seating is defined as: 

1) the teacher being placed so that he or she may see the rest of the 
children in the room as well ''a^ the children in the reading group and 

2) the placement of the children so that they can. see only the teacher 

and their vision of the rest of the room is hampered as much as possible. 

TVo scales arc therefore completed for the appropriateness of seating, one 

for the teacher and one for the child. In both cases \^ responds to very 

« 

inappropriate seating and 2 responds to appropriateness. Tlic points in 

i 
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* the« seale are determined by the percentage of error* For exattpXe» j[ on the ^ 

* 

scale for the teacher would indicate that the teacher could only see 50Z of . 
rest ot the class. A point of ^oa the children* s scale would indicate that 
50Z of the children in the group, could see what was going on in the rest of 
the classroom. In either case» if the seating arrangenent is inappropriate 
because of building restraints or some other factor beyond control of the 
teacher, then the '•beyond" box is also checked. If for some reason this 
scale is not applicable for either the teacher or the children, then.'*N/A 
Ieacher'*^or "N/A Children" is checked. The item is not applicable for the 
teacher whenever there is another adult in"^ the, room so that the teacher 
does not have to supervise the rest of the children. The item is not appli- 
cable 'for the children 'When there are no other children in the room and 
nothing else which would distract the children so that it does not natter 
how they are seated. 

9. Demons tr at ions /Expectations . The items in this category-' are com- 
pleted for each activity assigned by the teacher, up to five activities ; 
These usually involve workbook or seatwork assignments, which must be explained 
to the children so that they know what to do. The numbers at the top of the 
grids refer to the activity (first, second, «etc. )' and for each one, the ver- 
tical column is completed. The coder first determines for each activity 
whether a demonstration has "occurred," was *Hieeded, but did not occur," was 
"not -needed and did not occur" even though an activity is ab^ut to take place, 
or whether there is a "repetition of a demonstration" because a previous one 

♦ ♦ 

was insufficient. (The coder deteraincs whether or not a demonstration or 
explanation is needed by the reaction of the children.) If a demonstration 
has occurred, then the coder completes the "sufficiency" scale, which ranges' 
from a score of indicating a poor demonstration or explanation to a score 
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' of 5 Indicatlfig an excellent demonstration or explanation. The sufficaencyj 
is determined by the coder after considering the amount or detidl that was. 
included, the sequencing of the steps explained, and the overall clarity of 

♦ 

the explanation. The coder ^Iso indicates whether any checks fdr f eedbaclc 
were made by the teacher and wh^t kind were made. "Question" refers to a 
call for questions. (The teacher says something to the effect of, "Does 
everyone understand?" ..or "Are there any questions?") "Repeat" indicates 
that' the teacher has asked a child' or children to repeat the directions. 
••D^onstrate" means* that' the teacher has asked a child or children to demon- 
strate the activity by going through some examples. "Start lesson" is checked 
whenever the teacher is '^ng to observe the children working on the activity 
and can therefore check on their understanding while they are doing this. 
••None (WB)" is checked whenever the teacher gives an explanation of a work- 

* 

book activity,^ then dismisses the children to perform it, and does not have 
any checks for feedback. The "Children •s comprehensidn" of instructions for 
activities is noted for each demonstration or explanation by a 5-point scale 
in which I indicates that none of the children understood the directions and 
5 indicates that all of the children understood the directions. If the cioder 
caimot rate children's comprehension because they were dismissed from the 
group before the activity was performed, the category of "Can't rate" is 

checked. ' y ' , 

10. Ncw vogd.s . New words are vocabulary words or letters which are 

introduced to the children and are used in the lesson in som way. They do 

hot include word? or letters which i^rc the focus of an entire lesson. Five 

variables are considered for each new word or letter that is given, up to 

ten words or letters. For each new word.^thc co<ier indicates whether it 

was given at the beginning "of the lesson or during the lesson when it first 
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appeared. . The coder also indicatett whether the teacher gave the word to 
the ehlidren or had the child figure It out. The thlvd set of variables 
indicates whether the teacher gave phonics clues » context clues, or neither 
in presenting the new word. The. last two sets of items are concerned, with 
whether the teacher has the children repeat a new word or letter. If it is 
repeated, the coder indicates whether It was^done by choral or individual 
repetition, and whether or not all of the students had the chance to repeat 
the word or whether only some of th^ did. 

11. Choral and call out responses . The coder keeps a tally of the 

/ ♦ 

number of choral responses and group call outs occurring within that obser- 
vation period. Choral responses are defined as total group responses which 
are asked for by the teacher with the e3Q>ectation that all of the children 
in the group will respond with the same answer. Group call outs are defined 

♦ 

* 

as several children calling out the answer to a question, whether or not the. 
teacher has designated an individual to answer tlie question* They differ 
from choral responses in that thie teacher does not indicate beforehand that 
she wants mOre than one child to answer* 

12. Undesirable question * "Rhetorical" Is checked whenever the teacher 
asks a very obvious question and does not really expect an answer, s'uchl as 
*'Isn*t that a beautiful picture?" "Answers own" is checked whenever the 
teacher asks a question and answers it without calling on a child or waiting 
for a child to answer It. "Series"- is checked whenever the teacher asks more 
than one question in a row»wlthout waiting for a child to answer. Any other 
"undesirable" questions are noted under "other" and described. 

Indivi dual D ata 

* ^ * > 

ft 

Figure 2 presents the sheets used to record academic and behavioral Inter 
actions* T\xq number of those sheeta used for aach observation depends on the 



length of the. reading group* i 

^* Context * The code^ notes on each sheet the lesson context for all 
instructions on that page. ' \ 

* * 

••Slow, No WB** indicates a slow-paced question and answer session In 
which no workbook was involved. That is, the teacher is asking xiuestibns, 
children are answering, and the pace is not fast enough to consider it a 
drill. , 

•••WB'* stands for workbook activities. In this case each individual 
child is making some response to each question whether or not this is indi- 
cated ,by an oral response %^ich is coded. 

. ••Drill" is checked whenever there is rapid questioning and answering 
by the children. The determining characteristic of this context is, its 
rapidity. The teacher moves quickly from child to child and gives very 
little substantive feedback. 

•*New reading" is checked whenever the children are reading-^ stOiry 

from their textbook for the first time. They have not seen the material 

\ 

before. 

.••Rereading" is checked whenever it is apparent to the coder, usually 
because the .teacher has said something to that effect, that the children 
are rereading material that they have seen before. 

2. Teacher Out . In these blanks the cpder should note the time that 
the teacher was out of the group and also indicate by checking "beyond" if 
the teacher's absence on that particular occasion was due .to some factor 
beyond his or her control, suclT^S^a child getting sick, a phone call from 
the office, etc. 

The rest of this co'ding sheet is divided into two sections: "Response 
Opportunities" and "Behavioral Contacts." In the response opportunities 



8ectioa» eacK line corresponds to an interaction bet%reen the teacher and . 

♦ 

a child in which a question was a8ke4» the answer was giv^, and the teacher 
responded to the answer in sons way* \ 

3* jChild number , A child number is entered on each line to indicate 
which child in the group is interacting with the teacher. The number is 
/ entered under either 'Wle** or "female" to facilitate la.ter data analyses. 

4. Type of selection . .|ath line also includes a check in one and 

only one of the seven categories listed under Selection . There are two 

major types of selections, either initial selection or sti^sequent selection . 

Initial selection is used the first time the child is <^lled <m in a series' 

of interactions, and one of the two subsequent selection categories is checked 

for each continued interaction without interruption. The five types of initial 

selection are "order," in which the child is selected on the basis of the seat- 

Ing pattern, "preselect," In which the child is not selected on the basis of 

the seating pattern but is named before the question is asked, 'Hionvolunteer," 

in which the child is not selected on the basis of the seating pattern and is 

not called upon until after the question has been asked, "volunteer," in which 

the child is called upon because he or she. has raised a hand and offered to 
* y 

answer the question, and "call out," in which a child has called out an answer 
to a question without being designated by the teacher to answer that question 
and the answer is accepted by the teacher. The two types of subsequent selec- 
tibn are "continue" in which the interaction with the teacher is continued for 
some other purposes other than correcting a previous error and "error correc- 
tion," which is checked whenever the Interact ioh is being sustained with a 
child for the purpose of correcting a previous error. 

5, Comment . This . category is checked if the teacher has called on the 
child for the purpose of commenting about another child's answer for any other 
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reason than giving the correct answer to an incorrect question. 

6. Designation of reading turn . Either "turn" or "end of turn** is 
checked %»henever an interaction has occurred within a reading turn. These 
categories are necessary for later data analyses to separate ^ut single 
response opportunities and those which occurred within a reading turn* since 
the only lines of coding entered for a reading turn are those which involve 
an interaction with the teacher. That is, a child- may read correctly all 
the way through a turn and have no corrections and interactions with the 
teacher, in which case only one line of coding with "end of turn" checked 
would be entered to indicate that the child did read. However, if a child • 
read the same materal and had several mistakes and several interactions 
with the teacher because of those mistakes, there would be several lines of 
coding with **'%nrn** checked. Therefore, each interaction occurring within a 
reading turn is desigty^ed by checking one of these two categories. . 

7, Types' of questions . For each line of coding one of the nine cate- 
gories listed under Questions is checked. Questions may be either reading 
^taestions or nonreadinp questio ns. The categories considered under reading > 
question s are those which have to do with a child actually looking at a 
written symbol and saying a word or letter. Nonrcadlni^ questions have to 

do with any other type of question that is asked during the reading tuni 
that does not emphasize actually reading a written symbol. The categories 
of reading questions arc "repeat," In which a child is asked to look at a 
word and repeat what the teacher just said; "reading choice," in which the 
child is asked to choose between four or fewer altornatlvea In a question 
which emphasizes reading to make the correct choice; "word recognition," 
in which the task involves looking at a word and calliuj; its name; and 
"word attack," in which the quobticn requires the child to analyze a word 




or letter Into Its component letters or sounds,, or to answer a question about 
word attack skills. Types of nonreading questions are '•personal*' questions, 
which require the child to say something about his personal background or 
experience; **choice** questions which ask the child to choose between four or 
fewer alternatives in a situation that does not involve the reading of words 
in order to answer the question; "product** questions which require the child 
to give some kind of factual answer which ^is not related to the comprehension 
of the story just immediately read; **comprehension** questions which require 
the child to answer a question about the content of material which has Just 
been read; and **interpretatj^ve** questions which require the child to go ^ 
beyond some material which he or she has just read or heard and to either 
make predictions, evaluations, or interpretations about the material, as in, 
"What do you think is going to happen to pavid ..now?** 

8. Answers . For each line of coding one of the four categories of 
Answers must be checked. The question can be either "correct,** "incorrect," 
a child may answer "I don't know," or the child may make '*no response." 

^» No feedback . If the teacher makes no response to the child *8 answer 
and therefore does not give th^ child any indication of correctness or incor- 
rectness, thcH this category is checked. No other kind of feedback is checked 
when "no feedback" has occurred. 

10. General feedback * The five categories described here ©ay occur in 
cunjunctlon with other types of feedback with the exception of **no feedback." 
"Emphasis" Is checked whenever the teacher repeats the c^^lld^s answer for the 
ri!St of the group or has the child or another child repeat that answer for 
the purpose of the other children hearing it. "Process feedback" is checked 
whenevor the teacher goes beyond acknowledging or giving an answer and actually 
exijlaiuu the?, answer or the process used in arriving at that answer, such as 
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explaining the process of aouading out a word. •♦Praise** and "Criticism" 
are checked vhenever they occur. These categtries apply*to praise and- 
criticism of a child*s answers only. *'Specific'' is checked in conjunction 
either' praise or cirticism when the teacher has gone beyond a simple 
statement of good or bad and specifies what was good about the answer or 
what should have been done differently lo avoid criticism of the answer. 

11, Terminal feedback. The ..three categories desci:ibe<i here are used 
whenever the tfeacher do^s something to end that child's response opportunity 
about that ^luestion. The teacher can either "give the answer," "ask other," 
or accept a "call out," in which another child shouts out an answer or a 
correction before the teacher can respond and the teacher allows this to 
stand as feedback in termination of that question. ^ 

12, Sustaining feedback . The four categories Usted here are checked 
whenever the teacher does something which sustains an interaction with .that 
child. "New question" is checked when, the teacher asks the child a new 
question which does^not serve as an error correction, of a previous answer. 
The other three categories describe an attempt to have the child correct a 
previous error.. "Repeat" is checked whenever the teacher simply repeats 
the question or prods the child without giving any substantive help, "clue" 
is checked whenever the teacher gives ;iome help by rephrasing the question 
or giving clues but does not simplify the question so much that the answer 
is obvious, and "give" is checked whenever the teacher gives a clue or 
rephrases the qu<>«tlon In such .m obvious way that the child is almost • 
insured success on his second attempt at anHWorlng. 

13, Results . • Wlienever one of the last three types of sustaining feed- 
back is checked ("repeat." "clue," or "give") the res'ilt of that error cor- 
rection feedback is recorded by indicating whether the next "answer was 



0 



improved or was nofr improved. . 

■» 

The next block of categories concerns Behavioral Contacts by the 



tea^r. These are recorded independently of the Response O pportunities. 



catered to Indicate an dut-of-gfbt$ con^ac^. 

150 Behavior ntmber . One of the fourteen behavior numbers listed in ^ 
the upper right-hand comer of the coding sher c is entered in this columr 
for every line of coding, •the first ten are only applied to students in 
the reading group: 




1. •*Call out unaccepted" by the teacher and corrected. 

2. "Call out accepted" by the teacher for its academic 

• content but also corrected .for the call out behavior. 



3. 



"Individual inappropriate" behavior, which subsumes 
inattentive type behaviors or anything that a child 



does individually which is not appropriate to the 



reading group setting and does not fall into one of 



the other categories. 



4. "Social interaction" with another child in the reading 



group which is not desired. 



5. 



"Private disturbance" is an Individual's behavior 

t 

which^is loud enough or active enough to disturb the 



other children. * \ 

6. "Posture includes any inappropriate behavior related 



7. 



to sitting in the group. 

"Materials" includes any Inappropriate bclmvior 
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involving* the 1>ook8, papers » pencils » etc* used 

* • 

in the reading gro^s. activities* This includes 4 
holding the book upside down* being on the wrong * 

* 

pi|ge» misuse of the marker, ..etc* 
8* ''Contraband** includes the possession of any 

materials not appropriate to the reading group 

such as toys, gum, or books for other activities* 
9* **Other in-group** inappropriate behaviors not listed 

above* 

♦ • 

10* ''Praiseworthy" behavior occurring during the reading 
group* This is only followed by a teacher reaction 
of praise* The first nine items are all considered 
behaviors which result in a corrective contact* 
The next four behaviors are concerned only with out-of -group confacts: 
that is, the teacher interacts with a child that is not seated in the read- 
ing group* These behaviors are: 

11* "Child-initiated brief," in which the child approaches 
the teache^ and the contact is of a very brief duration 
(less than five seconds)* 
12* "Child-initiated long," in which the child approaches 
the teacher and the contact lasts longer than five 
seconds. 

^ 13e ••Teacher-initiated brief*" in which the teacher inter-- 
rupts the group to say something to those outside the 
group but the contact is brief (less than five seconds) « 
14e ••Teachers-initiated long/^ in which the teacher interrupts 
the group and the contact lasts longer than five seconds* 
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16 •* Teacher reactions , • The next seven categories are checked to 
indicate what kind of tc«^r reaction occurried within each of the hehav* 
loral contacts* **Pralse** Indicates that the teacher said something ahout 
how good a particular behavior was, **Ignore*^ Is used only for behavior 
categories of **call out unaccepted'* and the **chlld->lnltlated out'-of-group!* 
contacts. *lianag€9aent** Is checked whenever the teacher delivered a correc- 
tlve contact In aacalm, nonlrratated tone of vloce. **Warnlng** Indicates ' 

» 

' that the teacher showed Irritation or slight anger In the voice and Implied 
a threat to the child or some punishment If he or she does not comply. 
**Crlticl8m*' la checked whenever the teacher *s voice was extreme and demon-*' 
strated anger or delivered some punishment to the child because of the 

i • 

behavior. ''Nonverbal Interactlo^'* is checked whenever the teacher dellvei^« 
a corrective contact without saying anything; that Is, a* gesture of some 
sort served to corcect the child. . **Speciflclty** Is checked whenever any , 
of the previous caf'gorles just described (with the exception of J^gnore") 
was specific as to either what behavior is being praised or as to what 
alternative behavior is desirable In the case of the corrective contact. 
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, Appendix C * 
Glossary of retms Used to Describe Data from the 
First-Grade Seading Group Study 
The following is an alphabetical list of terns derived fro» the 
observation systea used to describe teacher and student. behaviors of 

# 4 

interest in the study* 

Academic interaction . This is also described as a response opportu- 
iiity > an oral interchange in which the teacher aslts an academic question 
of an individual student who answers in some, way and may receive .feedback 

from th& teacher. • . , 

Ask other* A type of terminal feedback, in which the teacher asks 

% 

a second child to answer a. question that was not answered correctly by 
the first respondent. 

Behavior contact . An interaction in which the teacher correct the 
child for some misbehavior or praises some behavior that was good. These 
interactions are not academic in nature. 

Call out . A type of sel^'^on in which a student answers a question 
without having been designated by the teacher (either by seating position 
or by being named) . It is also a type of terminal f eedbacTc when a second 
student cali^out an answer or gives soine kind of feedback after the first 
student* 6 answer was incorrect. This occura without the teacher calling 
on the second student to request the answer." 

Choice question . ^ type of question in which the student must select 
from four or fewer alternatives to answer a question £hat Is not about a 
word or sound. ^* 

Olue lcedback > ^ A type of sustaining feedback following an incorrect 
answer or* failure to respond. iThc teacher provides clues or simplified 
questions to help the same student get a better answer. 
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Comment « A second student Is asked by the teacher to cooment on the 
' answer given by the first* sudent* This is not done in order to provide 

the correct 8nsver» but to let the second student repeat the ans%ier or 

♦ • ♦ 

- » 

expand it« • « 

Comprehension question . A type of que'stion' In which the student pro* 

vides information about some material that his Just been read in the groiq>. 

Correct answer* ^ A type of answer that is acceptable to the teaches. 

Criticism (in academic interactions) . A type of feedback that includes 

♦ 

a very negative response to the child and/or the answer. 
> Criticism (in behavior contacts) . A type ^of teacher reaction to mis- 
behavior that included an angry tone of voice and/or the delivery of punish- 
ment.. ♦ 

« 

Don't know answer. . A type- of answer in which the studedt simply stated, 
"I don't know." 

Bnphasis feedback . A type of feedback by which the teacher (ensures that 
the rest of the group heard the answer and understood it. This usually means 

♦ 

t^t the teacher repeated it or h*ad a child repeat it. ^ 

J Feedback . The response .offered by a teacher to an individual student's 
answer to an academic -question. 

Give answer feedback . A type of terminal feedback in which* the teacher 
supplies the answer to a child who hasf not answered correctly. 

Cive by clue feedback . A type of sustaining feedback in which the teacher 
continues to ask questions to the child, but makes the new questions so simple 
that the answer is essentially given to the. child. difference between this 

category ,of feedback and that of give answer is that this technique elicits the 
correct answer frum the child who originally made the error. 

Ignore . A type of teacher reaction to misbehavior in which no acknowledg- 
ment is given by the teacher. Tlils category was only applicable to call outs 



mid chlld-lnltiated out->of -group interruptions. 

laprovcaaent* The cesult of sustaining feedback that led to a better 
answer than that originally given by the child* 

Incorrect answer * k type of -answer that was not acceptable. 

Interpretation question. A type of question in which the student is 
required to make predictions* evaluations, or interpretations. 

Hanagement . A tyire of teacher reaction to misbehavior that was mild 
in tone with no threat of punishment. • 

Hew question. A type of feedback in which the teacher asks a related 
question of a student who has just completed answering a question. 

No feedback . The absence of any feedback to an answer. The teacher 
did not; respond with affirmation or negation of the answer ind provided no 
other substantive feedback. , 

No improvement . The result of sustaining feedback that did not lead 
' to a better response than that given by the child to the ^original question. 



No response answer . A type of answer in which the*child did not say 
anything in response to the teacher's question. 

^ Nonreadlng questions . A large category of questions composed of five 
smaller categories: personal, choice, product, comprehension, and inter- 
pretation having in common that the student is being asked a que8*-ion about 
a fact, the content of what has been read, or is asked for an opinion. See 
also reading question * 

Nonturn response opportunttle^ . The interaction between the teacher 
and child did not take place while the child was reading a sentence or 
prssdge aloud. 

Nonver bal Interventton e A type of teacher reaction to misbehavior 

» 

that consisted of a gesture, look, or finger-snap. 
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jtotivolmiteer. A type of selection in which thy teacher asks ^es- 
tion and. then calls on a child who has not volitnteeced to an8iier,*and who 
was not previously designated to answer because of his or her seating 
position. * . * . 

Ordered selection* A type of selection based on seating positicAi 
because the teacher was using a pattern of selection, such as gc^g frca 
one end of the group to the other. , r 

• Personal question. A type of question in %ihich the student was asked 
to describe a personal experience or state an opinion about pers(»ial pref- 

• ♦ 

erence* 

graise. A type of academic feedback or reaction, to student behavior 
^ which the teacher indicates a very favorable^, positive response to the 
child, the answer, or the behavior. 

* 

* 

Preselect . A type of selection ih which the teadfer nante^ a partic- 
ular child before asking a question and is apparently not selecting the 

student because of his or her seating position. 

Process feedback. A type of feedback in which the/^teacher explains 
the steps o^ process necessary td solve a problem or answer a question. 

Product question . A 'type of question in which the^student must pro- 

« 

dute some fact or label from memory that does, not include reading a word 

V 

or answering a comprehension question. 

Reading choice question . A type of question in which the student 
must choose between four or fewer alternatives that answer a question about 
a word, letter, .or sound. | 

Reading question% A large category of questions composed of four 
smaller categories: repetition, reading choice, word attack, and word 
recognition, which have In common that the student Is asked to decode or 
*14cntify words, letters, or sounds. See also nonrcadlng questions . 
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Repeat feedback . A type of sustaining feedback in which the teacher 
repeats the original^u^tionx without providing any more information » or 

othezwise encourages the child to respond wibhoue providing any substan- 

\ * ♦ 

* 

tive help* 

Bepetition question . A type of question in which the student is asked 
to repeat a wqrd that has just been read. 

Response opportunity (R.O.). An interaction between a teacher and an 
individual child in the reading group about an academic question. It con- . 
sists of three parts: the question asked by the teacher, the response of 
the child, and the feedback delivered by the teacher. 

Result of sustaining feedback . Indication as to whether* or not the 
.teacher's efforts actualiy led to a. better response by the child. This 
wiis classified as either Improvement or ia> Improvement . 

Specificity . When tised with praise , this term means that the praise 

specified exactly what was good about what the child just did or said. When 

i 

used with crltlcUsm , It indicates that the teacher was specific about what 
should have been done Instead of the criticized behavior. 

Sustained Interaction . A response opportunity (teacher question, child 
answer, and teacher feedback) which was the result of the teacher offering 
sustaining feedback to the Incorrect answer just given by the child. 

Sustalnirt^ feedback . Teacher response to a child who has answered 

incorrectly, has said "I don't know," or has failed to respond. The teacher 

« 

stays with the child for another Interaction instead of glvixig terminal 

feedback. ^ 

Terminal feedback . A response offered by the teacher when the chlld> 
answer was Incorrect, "I don't know." or a failure to respond, ending the 
child's opportunity, to answer that question by provWing the answer or having 
it provided. • . 



Total response opportunities « Response oppprtunities that are not 
diitinguished as to iihethw/ or no* thay occurred during a raadint turn* 

Turn response opportunities* Acadeaiic interactions (response oppor- 
tunities) that occurred trhile the child was reading a sentence or passage 
aloud. 

Warning* A type of teacher reaction to misbehavior 4:hat included an 
irritated tone of voice and perhaps an implied or stated threat of punish- 
ment'* 

Word attack question, A type of question in which the student must 
give, information about sounds of" letters within a word, or about the pro- 
cess of breaking down a word into its component parts. 

Word recognition question . A type of question in Which the dtudent 
must say the name of a word or letter by reading it aloud. 
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